Bias from historical control groups used in orthodontic research: a meta-epidemiological study
Open Access
- 29 April 2016
- journal article
- research article
- Published by Oxford University Press (OUP) in European Journal of Orthodontics
- Vol. 39 (1) , 98-105
Abstract
The validity of meta-analysis is dependent upon the quality of included studies. Here, we investigated whether the design of untreated control groups (i.e. source and timing of data collection) influences the results of clinical trials in orthodontic research. This meta-epidemiological study used unrestricted literature searching for meta-analyses in orthodontics including clinical trials with untreated control groups. Differences in standardized mean differences (ΔSMD) and their 95% confidence intervals (CIs) were calculated according to the untreated control group through multivariable random-effects meta-regression controlling for nature of the interventional group and study sample size. Effects were pooled with random-effects synthesis, followed by mixed-effect subgroup and sensitivity analyses. Studies with historical control groups reported deflated treatment effects compared to studies with concurrent control groups (13 meta-analyses; ΔSMD = −0.31; 95% CI = −0.53, −0.10; P = 0.004). Significant differences were found according to the type of historical control group (based either on growth study or clinical archive; 11 meta-analyses; ΔSMD = 0.40; 95% CI = 0.21, 0.59; P < 0.001). The use of historical control groups in orthodontic clinical research was associated with deflation of treatment effects, which was independent from whether the interventional group was prospective or retrospective and from the study’s sample size. Caution is warranted when interpreting clinical studies with historical untreated control groups or when interpreting systematic reviews that include such studies. PROSPERO (CRD42015024179). None.Keywords
This publication has 34 references indexed in Scilit:
- Evidence and clinical decisions: Asking the right questions to obtain clinically useful answersSeminars in Orthodontics, 2013
- Evaluation of methodology and quality characteristics of systematic reviews in orthodonticsOrthodontics & Craniofacial Research, 2011
- What are we reading? An analysis of the orthodontic literature 1999 to 2008American Journal of Orthodontics and Dentofacial Orthopedics, 2011
- A Re-Evaluation of Random-Effects Meta-AnalysisJournal of the Royal Statistical Society Series A: Statistics in Society, 2008
- Controlling the risk of spurious findings from meta‐regressionStatistics in Medicine, 2004
- Measuring inconsistency in meta-analysesBMJ, 2003
- Improved tests for a random effects meta‐regression with a single covariateStatistics in Medicine, 2003
- Clinical trials in orthodontics I: demographic details of clinical trials published in three orthodontic journals between 1989 and 1998Journal of Orthodontics, 2003
- Moving forward by looking back: ‘Retrospective’ clinical studiesJournal of Orthodontics, 2002
- A review of clinical research in orthodonticsAmerican Journal of Orthodontics and Dentofacial Orthopedics, 1989