Bias and inference from misspecified mixed‐effect models in stepped wedge trial analysis
Open Access
- 28 May 2017
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 36 (23) , 3670-3682
Abstract
Many stepped wedge trials (SWTs) are analysed by using a mixed‐effect model with a random intercept and fixed effects for the intervention and time periods (referred to here as the standard model). However, it is not known whether this model is robust to misspecification.We simulated SWTs with three groups of clusters and two time periods; one group received the intervention during the first period and two groups in the second period. We simulated period and intervention effects that were either common‐to‐all or varied‐between clusters. Data were analysed with the standard model or with additional random effects for period effect or intervention effect. In a second simulation study, we explored the weight given to within‐cluster comparisons by simulating a larger intervention effect in the group of the trial that experienced both the control and intervention conditions and applying the three analysis models described previously.Across 500 simulations, we computed bias and confidence interval coverage of the estimated intervention effect.We found up to 50% bias in intervention effect estimates when period or intervention effects varied between clusters and were treated as fixed effects in the analysis. All misspecified models showed undercoverage of 95% confidence intervals, particularly the standard model. A large weight was given to within‐cluster comparisons in the standard model.In the SWTs simulated here, mixed‐effect models were highly sensitive to departures from the model assumptions, which can be explained by the high dependence on within‐cluster comparisons. Trialists should consider including a random effect for time period in their SWT analysis model. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.Keywords
Funding Information
- Medical Research Council (MR/L004933/1‐P27)
- Medical Research Council (MR/L004933/1-P27)
This publication has 21 references indexed in Scilit:
- Re-analysis of health and educational impacts of a school-based deworming programme in western Kenya: a statistical replication of a cluster quasi-randomized stepped-wedge trialInternational Journal of Epidemiology, 2015
- Finite-sample corrected generalized estimating equation of population average treatment effects in stepped wedge cluster randomized trialsStatistical Methods in Medical Research, 2014
- Stepped wedge designs could reduce the required sample size in cluster randomized trialsJournal of Clinical Epidemiology, 2013
- Consort 2010 statement: extension to cluster randomised trialsBMJ, 2012
- Design and analysis of stepped wedge cluster randomized trialsContemporary Clinical Trials, 2007
- Analysis of cluster randomized cross‐over trial data: a comparison of methodsStatistics in Medicine, 2006
- Worms: Identifying Impacts on Education and Health in the Presence of Treatment ExternalitiesEconometrica, 2003
- Misspecified maximum likelihood estimates and generalised linear mixed modelsBiometrika, 2001
- Data analysis and sample size issues in evaluations of community-based health promotion and disease prevention programs: A mixed-model analysis of variance approachJournal of Clinical Epidemiology, 1991
- Longitudinal data analysis using generalized linear modelsBiometrika, 1986