Performance of analytical methods for overdispersed counts in cluster randomized trials: Sample size, degree of clustering and imbalance
- 11 August 2009
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 28 (24) , 2989-3011
Abstract
Many different methods have been proposed for the analysis of cluster randomized trials (CRTs) over the last 30 years. However, the evaluation of methods on overdispersed count data has been based mostly on the comparison of results using empiric data; i.e. when the true model parameters are not known. In this study, we assess via simulation the performance of five methods for the analysis of counts in situations similar to real community‐intervention trials. We used the negative binomial distribution to simulate overdispersed counts of CRTs with two study arms, allowing the period of time under observation to vary among individuals. We assessed different sample sizes, degrees of clustering and degrees of cluster‐size imbalance. The compared methods are: (i) the two‐sample t‐test of cluster‐level rates, (ii) generalized estimating equations (GEE) with empirical covariance estimators, (iii) GEE with model‐based covariance estimators, (iv) generalized linear mixed models (GLMM) and (v) Bayesian hierarchical models (Bayes‐HM). Variation in sample size and clustering led to differences between the methods in terms of coverage, significance, power and random‐effects estimation. GLMM and Bayes‐HM performed better in general with Bayes‐HM producing less dispersed results for random‐effects estimates although upward biased when clustering was low. GEE showed higher power but anticonservative coverage and elevated type I error rates. Imbalance affected the overall performance of the cluster‐level t‐test and the GEE's coverage in small samples. Important effects arising from accounting for overdispersion are illustrated through the analysis of a community‐intervention trial on Solar Water Disinfection in rural Bolivia. Copyright © 2009 John Wiley & Sons, Ltd.Keywords
Funding Information
- National Institutes of Health (R01AI50087-01IH)
- Stipendiumkommission of the Amt für Ausbildungsbeiträge of the Canton of Basel, Switzerland
This publication has 59 references indexed in Scilit:
- Solar Drinking Water Disinfection (SODIS) to Reduce Childhood Diarrhoea in Rural Bolivia: A Cluster-Randomized, Controlled TrialPLOS Medicine, 2009
- Rank-Based Estimation and Associated Inferences for Linear Models With Cluster Correlated ErrorsJournal of the American Statistical Association, 2009
- Fixed effects, random effects and GEE: What are the differences?Statistics in Medicine, 2008
- Effect of solar water disinfection (SODIS) on model microorganisms under improved and field SODIS conditionsJournal of Water Supply: Research and Technology—AQUA, 2007
- A simulation study of odds ratio estimation for binary outcomes from cluster randomized trialsStatistics in Medicine, 2006
- Relative efficiency of unequal versus equal cluster sizes in cluster randomized and multicentre trialsStatistics in Medicine, 2006
- Flexible random‐effects models using Bayesian semi‐parametric models: applications to institutional comparisonsStatistics in Medicine, 2006
- Methods for modelling change in cluster randomization trialsStatistics in Medicine, 2004
- Two Ways of Modelling Overdispersion in Non-Normal DataJournal of the Royal Statistical Society Series C: Applied Statistics, 2000
- Small sample characteristics of generalized estimating equationsCommunications in Statistics - Simulation and Computation, 1995