The Fragility of Statistical Findings in Achilles Tendon Injury Research: A Systematic Review
Open Access
- 1 September 2021
- journal article
- research article
- Published by Wolters Kluwer Health in JAAOS: Global Research and Reviews
- Vol. 5 (9)
Abstract
Introduction: Probability analysis with the reporting of P values is often used to determine the statistical significance of study findings in the Achilles literature. The purpose of this study was to determine the utility of applying a fragility analysis to comparative trials evaluating Achilles tendon injuries. Methods: We identified all dichotomous outcome data for comparative studies of Achilles tendon injuries published in 11 orthopaedic journals from 2000 to 2020. The fragility index (FI) was determined by the number of event reversals required to change a P value from less than 0.05 to greater than 0.05, or vice-versa. The associated fragility quotient was determined by dividing the FI by the sample size. Results: Of the 51,357 studies screened, 1,487 met the search criteria, with 51 comparative studies and 177 total outcome events included for analysis. The overall FI was only 4 with an associated fragility quotient of 0.048. One-half of the studies failed to report lost to follow-up data, with an additional 21.6% reporting loss to follow-up of greater than or equal to 4. Conclusion: Our fragility analysis suggests that Achilles tendon injury outcomes are not as statistically stable as previously thought and should be interpreted with caution.Keywords
This publication has 29 references indexed in Scilit:
- Statistical tests, P values, confidence intervals, and power: a guide to misinterpretationsEuropean Journal of Epidemiology, 2016
- The fragility of statistically significant findings from randomized trials in spine surgery: a systematic surveyThe Spine Journal, 2015
- The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility IndexJournal of Clinical Epidemiology, 2014
- Percutaneous versus open repair of acute Achilles tendon rupturesEuropean Journal of Orthopaedic Surgery & Traumatology, 2013
- Efficacy and complications of open and minimally invasive surgery in acute Achilles tendon rupture: a prospective randomised clinical study—preliminary reportInternational Orthopaedics, 2012
- Operativeversusnon-operative treatment of acute rupture of tendo AchillisThe Journal of Bone and Joint Surgery. British volume, 2011
- P Value and the Theory of Hypothesis Testing: An Explanation for New ResearchersClinical Orthopaedics and Related Research, 2010
- Contradicted and Initially Stronger Effects in Highly Cited Clinical ResearchJAMA, 2005
- Sifting the evidence---what's wrong with significance tests? Another comment on the role of statistical methodsBMJ, 2001
- The unit fragility index: An additional appraisal of “statistical significance” for a contrast of two proportionsJournal of Clinical Epidemiology, 1990