Increasing the efficiency of randomized trial estimates via linear adjustment for a prognostic score
Preprint
Abstract
Estimating causal effects from randomized experiments is central to clinical research. Reducing the statistical uncertainty in these analyses is an important objective for statisticians. Registries, prior trials, and health records constitute a growing compendium of historical data on patients under standard-of-care that may be exploitable to this end. However, most methods for historical borrowing achieve reductions in variance by sacrificing strict type-I error rate control. Here, we propose a use of historical data that exploits linear covariate adjustment to improve the efficiency of trial analyses without incurring bias. Specifically, we train a prognostic model on the historical data, then estimate the treatment effect using a linear regression while adjusting for the trial subjects' predicted outcomes (their prognostic scores). We prove that, under certain conditions, this prognostic covariate adjustment procedure attains the minimum variance possible among a large class of estimators. When those conditions are not met, prognostic covariate adjustment is still more efficient than raw covariate adjustment and the gain in efficiency is proportional to a measure of the predictive accuracy of the prognostic model above and beyond the linear relationship with the raw covariates. We demonstrate the approach using simulations and a reanalysis of an Alzheimer's Disease clinical trial and observe meaningful reductions in mean-squared error and the estimated variance. Lastly, we provide a simplified formula for asymptotic variance that enables power calculations that account for these gains. Sample size reductions between 10% and 30% are attainable when using prognostic models that explain a clinically realistic percentage of the outcome variance.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Power gains by using external information in clinical trials are typically not possible when requiring strict type I error controlBiometrical Journal, 2019
- Federated learning of predictive models from federated Electronic Health RecordsInternational Journal of Medical Informatics, 2018
- The power prior: theory and applicationsStatistics in Medicine, 2015
- Development of a unified clinical trial database for Alzheimer's diseaseAlzheimer's & Dementia, 2015
- Desideratum for Evidence Based EpidemiologyDrug Safety, 2013
- Docosahexaenoic Acid Supplementation and Cognitive Decline in Alzheimer DiseaseJAMA, 2010
- Value and Limitations of Existing Scores for the Assessment of Cardiovascular RiskJACC, 2009
- Randomized Clinical Trials and Observational StudiesJACC: Cardiovascular Interventions, 2008
- On regression adjustments to experimental dataAdvances in Applied Mathematics, 2008
- How to Select Covariates to Include in the Analysis of a Clinical TrialControlled Clinical Trials, 2000