Assessment and Implication of Prognostic Imbalance in Randomized Controlled Trials with a Binary Outcome – A Simulation Study
Open Access
- 22 May 2012
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 7 (5) , e36677
Abstract
Chance imbalance in baseline prognosis of a randomized controlled trial can lead to over or underestimation of treatment effects, particularly in trials with small sample sizes. Our study aimed to (1) evaluate the probability of imbalance in a binary prognostic factor (PF) between two treatment arms, (2) investigate the impact of prognostic imbalance on the estimation of a treatment effect, and (3) examine the effect of sample size (n) in relation to the first two objectives. We simulated data from parallel-group trials evaluating a binary outcome by varying the risk of the outcome, effect of the treatment, power and prevalence of the PF, and n. Logistic regression models with and without adjustment for the PF were compared in terms of bias, standard error, coverage of confidence interval and statistical power. For a PF with a prevalence of 0.5, the probability of a difference in the frequency of the PF≥5% reaches 0.42 with 125/arm. Ignoring a strong PF (relative risk = 5) leads to underestimating the strength of a moderate treatment effect, and the underestimate is independent of n when n is >50/arm. Adjusting for such PF increases statistical power. If the PF is weak (RR = 2), adjustment makes little difference in statistical inference. Conditional on a 5% imbalance of a powerful PF, adjustment reduces the likelihood of large bias. If an absolute measure of imbalance ≥5% is deemed important, including 1000 patients/arm provides sufficient protection against such an imbalance. Two thousand patients/arm may provide an adequate control against large random deviations in treatment effect estimation in the presence of a powerful PF. The probability of prognostic imbalance in small trials can be substantial. Covariate adjustment improves estimation accuracy and statistical power, and hence should be performed when strong PFs are observed.Keywords
This publication has 34 references indexed in Scilit:
- Covariate adjustment increases statistical power in randomized controlled trialsJournal of Clinical Epidemiology, 2010
- Statistical considerations in evaluating pharmacogenomics-based clinical effect for confirmatory trialsClinical Trials, 2010
- Reporting on covariate adjustment in randomised controlled trials before and after revision of the 2001 CONSORT statement: a literature reviewTrials, 2010
- Reporting of sample size calculation in randomised controlled trials: reviewBMJ, 2009
- Committee for proprietary medicinal products (CPMP) points to consider on adjustment for baseline covariatesStatistics in Medicine, 2004
- Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problemsStatistics in Medicine, 2002
- Confounding and Collapsibility in Causal InferenceStatistical Science, 1999
- Tissue Plasminogen Activator for Acute Ischemic StrokeNew England Journal of Medicine, 1995
- Reducing Bias in Observational Studies Using Subclassification on the Propensity ScoreJournal of the American Statistical Association, 1984
- The randomization and stratification of patients to clinical trialsJournal of Chronic Diseases, 1974