Alternatives to randomisation in the evaluation of public-health interventions: statistical analysis and causal inference
- 6 August 2009
- journal article
- review article
- Published by BMJ in Journal of Epidemiology and Community Health
- Vol. 65 (7) , 576-581
Abstract
Background In non-randomised evaluations of public-health interventions, statistical methods to control confounding will usually be required. We review approaches to the control of confounding and discuss issues in drawing causal inference from these studies. Methods Non-systematic review of literature and mathematical data-simulation. Results Standard stratification and regression techniques will often be appropriate, but propensity scores may be useful where many confounders need to be controlled, and data are limited. All these techniques require that key putative confounders are measured accurately. Instrumental variables offer, in theory, a solution to the problem of unknown or unmeasured confounders, but identifying an instrument which meets the required conditions will often be challenging. Obtaining measurements of the outcome variable in both intervention and control groups before the intervention is introduced allows balance to be assessed, and these data may be used to help control confounding. However, imbalance in outcome measures at baseline poses challenges for the analysis and interpretation of the evaluation, highlighting the value of adopting a design strategy that maximises the likelihood of achieving balance. Finally, when it is not possible to have any concurrent control group, making multiple measures of outcome pre- and postintervention can enable the estimation of intervention effects with appropriate statistical models. Conclusion For non-randomised designs, careful statistical analysis can help reduce bias by confounding in estimating intervention effects. However, investigators must report their methods thoroughly and be conscious and critical of the assumptions they must make whenever they adopt these designs.Keywords
This publication has 36 references indexed in Scilit:
- The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation StudyAmerican Journal of Epidemiology, 2007
- Advanced Methods for Evaluating the Impact of Family Planning Communication Programs: Evidence from Tanzania and NepalStudies in Family Planning, 2006
- A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methodsJournal of Clinical Epidemiology, 2006
- A definition of causal effect for epidemiological researchJournal of Epidemiology and Community Health, 2004
- Improving the Reporting Quality of Nonrandomized Evaluations of Behavioral and Public Health Interventions: The TREND StatementAmerican Journal of Public Health, 2004
- Air Pollution and Hospital Admissions for Heart Disease in Eight U.S. CountiesEpidemiology, 1999
- Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control groupStatistics in Medicine, 1998
- Better reporting of randomised controlled trials: the CONSORT statementBMJ, 1996
- Direct and Indirect Effects in Vaccine Efficacy and EffectivenessAmerican Journal of Epidemiology, 1991
- EFFEC OF THE USE OF UNRELIABLE SURROGATE VARIABLES ON THE VALIDITY OF EPIDEMIOLOGIC RESEARCH STUDIESAmerican Journal of Epidemiology, 1984