Statistical Assumptions in Orthopaedic Literature: Are Study Findings at Risk?
Open Access
- 12 October 2021
- journal article
- research article
- Published by Springer Nature in Cureus
- Vol. 13 (10)
Abstract
As orthopaedic surgery becomes more evidence-based, the need for rigorous research has increased. This results in more complex studies that employ more sophisticated statistical analysis, often some form of regression. These statistical techniques require the data to meet certain assumptions for the findings to be considered valid. The purpose of this study is to determine the common regression techniques employed in the orthopaedic surgery literature, and demonstrate how often the assumptions of regression analyses are met and reported. Studies published in the Journal of Bone & Joint Surgery (JBJS) in 2017 and 2018 were reviewed. Commentaries, editorials, and systematic reviews were excluded. The statistical analyses performed in each study were documented. When regression analyses were utilized, the article was reviewed for evidence that the necessary assumptions underlying the statistical methodology were assessed and met. From the 470 studies that were reviewed, the most common statistical test reported was the independent-samples t-test (n=215, 45.7%). Also, 201 studies (42.8%) implemented some form of regression analysis. The most common regression was a logistic regression (n= 106). None of the 201 studies using regression analysis reported meeting all of the necessary assumptions to appropriately use a regression test. Many recent studies published in JBJS depended on regression analyses to reach their conclusions, but none fully reported the necessary assumptions of these tests. Orthopaedic surgery journals should be more transparent in reporting the methodology of statistical tests, and readers must beware of possible gaps in statistical methodology and critically evaluate the studies' findings.Keywords
This publication has 18 references indexed in Scilit:
- Quality Reporting of Multivariable Regression Models in Observational StudiesMedicine, 2016
- The fragility of statistically significant findings from randomized trials in spine surgery: a systematic surveyThe Spine Journal, 2015
- A Study of Effects of MultiCollinearity in the Multivariable Analysis2014
- Statistical Trends in the Journal of the American Medical Association and Implications for Training across the Continuum of Medical EducationPLOS ONE, 2013
- Loss of Follow-Up in Orthopaedic TraumaJournal of Orthopaedic Trauma, 2013
- An evaluation of the quality of statistical design and analysis of published medical research: results from a systematic survey of general orthopaedic journalsBMC Medical Research Methodology, 2012
- Statistical Assumptions of Substantive Analyses Across the General Linear Model: A Mini-ReviewFrontiers in Psychology, 2012
- Are Assumptions of Well-Known Statistical Techniques Checked, and Why (Not)?Frontiers in Psychology, 2012
- What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type ModelsPsychosomatic Medicine, 2004
- Statistical Practices of Educational Researchers: An Analysis of Their ANOVA, MANOVA, and ANCOVA AnalysesReview of Educational Research, 1998