Estimating risk from underpowered, but statistically significant, studies: was APPROVe on TARGET?
Open Access
- 12 December 2010
- journal article
- editorial
- Published by Hindawi Limited in Journal of Clinical Pharmacy and Therapeutics
- Vol. 36 (6) , 637-641
Abstract
What is known and objective: The importance of statistical power is widely recognized from a pre-trial perspective, and when interpreting results that are not statistically significant. It is less well recognized that poor power can lead to inflated estimates of the effect size when statistically significant results are observed. We use trial simulations to quantify this bias, which we term ‘significant-result bias’. Comment: Significant-result bias is explained, and simulations are used to estimate possible significant-result bias in the rate of thrombotic events observed in the APPROVe trial. Statistically significant results, on outcomes for which there is empirical evidence of poor power, may provide inflated estimates of the size of effect. What is new and conclusion: If independent evidence is available to judge the likely effect size of an underpowered statistical test, trial simulations can provide a method for quantifying significant-result bias.Keywords
This publication has 17 references indexed in Scilit:
- Doing More Good than Harm: Need for a Cease FireThe American Journal of Medicine, 2009
- Do selective cyclo-oxygenase-2 inhibitors and traditional non-steroidal anti-inflammatory drugs increase the risk of atherothrombosis? Meta-analysis of randomised trialsBMJ, 2006
- Cardiovascular Events Associated with Rofecoxib in a Colorectal Adenoma Chemoprevention TrialNew England Journal of Medicine, 2005
- LumiracoxibDrugs, 2004
- Selective COX-2 inhibition and cardiovascular effects: a review of the rofecoxib development programAmerican Heart Journal, 2003
- Low P-Values or Narrow Confidence Intervals: Which Are More Durable?Epidemiology, 2001
- It’s Time to Rehabilitate the P-ValueEpidemiology, 2001
- Large-scale randomized evidence: Large, simple trials and overviews of trialsJournal of Clinical Epidemiology, 1995
- An Assessment of Publication Bias Using a Sample of Published Clinical TrialsJournal of the American Statistical Association, 1989
- Estimating Cancer Risks from Low Doses of Ionizing RadiationScience, 1980