Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
Open Access
- 16 June 2009
- journal article
- research article
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 9 (1) , 37
Abstract
Background: Cluster randomized trials (CRTs) are increasingly used to assess the effectiveness of interventions to improve health outcomes or prevent diseases. However, the efficiency and consistency of using different analytical methods in the analysis of binary outcome have received little attention. We described and compared various statistical approaches in the analysis of CRTs using the Community Hypertension Assessment Trial (CHAT) as an example. The CHAT study was a cluster randomized controlled trial aimed at investigating the effectiveness of pharmacy-based blood pressure clinics led by peer health educators, with feedback to family physicians (CHAT intervention) against Usual Practice model (Control), on the monitoring and management of BP among older adults. Methods: We compared three cluster-level and six individual-level statistical analysis methods in the analysis of binary outcomes from the CHAT study. The three cluster-level analysis methods were: i) un-weighted linear regression, ii) weighted linear regression, and iii) random-effects meta-regression. The six individual level analysis methods were: i) standard logistic regression, ii) robust standard errors approach, iii) generalized estimating equations, iv) random-effects meta-analytic approach, v) random-effects logistic regression, and vi) Bayesian random-effects regression. We also investigated the robustness of the estimates after the adjustment for the cluster and individual level covariates. Results: Among all the statistical methods assessed, the Bayesian random-effects logistic regression method yielded the widest 95% interval estimate for the odds ratio and consequently led to the most conservative conclusion. However, the results remained robust under all methods – showing sufficient evidence in support of the hypothesis of no effect for the CHAT intervention against Usual Practice control model for management of blood pressure among seniors in primary care. The individual-level standard logistic regression is the least appropriate method in the analysis of CRTs because it ignores the correlation of the outcomes for the individuals within the same cluster. Conclusion: We used data from the CHAT trial to compare different methods for analysing data from CRTs. Using different methods to analyse CRTs provides a good approach to assess the sensitivity of the results to enhance interpretation.Keywords
This publication has 34 references indexed in Scilit:
- Selection bias in cluster trialBMJ, 2008
- A simulation study of odds ratio estimation for binary outcomes from cluster randomized trialsStatistics in Medicine, 2006
- Developments in cluster randomized trials and Statistics in MedicineStatistics in Medicine, 2006
- Using Generalized Estimating Equations for Longitudinal Data AnalysisOrganizational Research Methods, 2004
- CONSORT statement: extension to cluster randomised trialsBMJ, 2004
- Comparison of methods for analysing cluster randomized trials: an example involving a factorial designInternational Journal of Epidemiology, 2003
- Using Heteroscedasticity Consistent Standard Errors in the Linear Regression ModelThe American Statistician, 2000
- Review of Software to Fit Generalized Estimating Equation Regression ModelsThe American Statistician, 1999
- A geometric approach to assess bias due to omitted covariates in generalized linear modelsBiometrika, 1993
- A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for HeteroskedasticityEconometrica, 1980