Evaluating a shrinkage estimator for the treatment effect in clinical trials
Open Access
- 19 December 2023
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 43 (5) , 855-868
Abstract
The main objective of most clinical trials is to estimate the effect of some treatment compared to a control condition. We define the signal‐to‐noise ratio (SNR) as the ratio of the true treatment effect to the SE of its estimate. In a previous publication in this journal, we estimated the distribution of the SNR among the clinical trials in the Cochrane Database of Systematic Reviews (CDSR). We found that the SNR is often low, which implies that the power against the true effect is also low in many trials. Here we use the fact that the CDSR is a collection of meta‐analyses to quantitatively assess the consequences. Among trials that have reached statistical significance we find considerable overoptimism of the usual unbiased estimator and under‐coverage of the associated confidence interval. Previously, we have proposed a novel shrinkage estimator to address this “winner's curse.” We compare the performance of our shrinkage estimator to the usual unbiased estimator in terms of the root mean squared error, the coverage and the bias of the magnitude. We find superior performance of the shrinkage estimator both conditionally and unconditionally on statistical significance.Keywords
This publication has 16 references indexed in Scilit:
- Low statistical power in biomedical science: a review of three human research domainsRoyal Society Open Science, 2017
- Beyond Power CalculationsPerspectives on Psychological Science, 2014
- Power failure: why small sample size undermines the reliability of neuroscienceNature Reviews Neuroscience, 2013
- Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysisBMC Medical Research Methodology, 2011
- Conducting Meta-Analyses inRwith themetaforPackageJournal of Statistical Software, 2010
- Why Most Discovered True Associations Are InflatedEpidemiology, 2008
- The 1988 Neyman Memorial Lecture: A Galtonian Perspective on Shrinkage EstimatorsStatistical Science, 1990
- Robust Locally Weighted Regression and Smoothing ScatterplotsJournal of the American Statistical Association, 1979
- Data Analysis Using Stein's Estimator and its GeneralizationsJournal of the American Statistical Association, 1975
- Stein's Estimation Rule and Its Competitors--An Empirical Bayes ApproachJournal of the American Statistical Association, 1973