The Unknown Prevalence of Postrandomization Bias in 15 Physical Therapy Journals: A Methods Review
Authors:
- Sean P. RileySRSean P. Riley
- Brian T. SwansonBSBrian T. Swanson
- Stephen M. ShafferSSStephen M. Shaffer
- Steven F. SawyerSSSteven F. Sawyer
- Joshua A. ClelandJCJoshua A. Cleland
- 1 November 2021
- journal article
- review article
- Published by Journal of Orthopaedic & Sports Physical Therapy (JOSPT) in Journal of Orthopaedic & Sports Physical Therapy
- Vol. 51 (11) , 542-550
Abstract
Objectives: To determine the prevalence of prospective clinical trial registration and postrandomization bias in published musculoskeletal physical therapy randomized clinical trials (RCTs). Design: A methods review. Literature Search: Articles indexed in MEDLINE and published between January 2016 and July 2020 were included. Study Selection Criteria: Two independent blinded reviewers identified the RCTs using Covidence. We included RCTs related to musculoskeletal interventions that were published in International Society of Physiotherapy Journal Editors member journals. Data Synthesis: Data were extracted independently for the variables of interest from the identified RCTs by 2 blinded reviewers. The data were presented descriptively or in frequency tables. Results: One hundred thirty-eight RCTs were identified. One third of RCTs were consistent with their prospectively registered intent (49/138); consistency with prospectively registered intent could not be determined for two thirds (89/138) of the RCTs. Four RCTs (8%)reported inconsistent results with the primary aims and 7 (14%) with the outcomes from the prospective clinical trial registry, despite high methodological quality (Physiotherapy Evidence Database [PEDro] scale score). Differences between prospectively registered and non-prospectively registered RCTs for PEDro scale scores had a medium effect size (r = 0.30). Two of 15 journals followed their clinical trial registration policy 100% of the time; in 1 journal, the published RCTs were consistent with the clinical trial registration. Conclusion: Postrandomization bias in musculoskeletal physical therapy RCTs could not be ruled out, due to the lack of prospective clinical trial registration and detailed data analysis plans. J Orthop Sports Phys Ther 2021;51(11):542–550. Epub 21 Sep 2021. doi:10.2519/jospt.2021.10491Keywords
This publication has 90 references indexed in Scilit:
- A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samplesBMC Medical Research Methodology, 2013
- Measuring the Prevalence of Questionable Research Practices With Incentives for Truth TellingPsychological Science, 2012
- The Cochrane Collaboration's tool for assessing risk of bias in randomised trialsBMJ, 2011
- Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposedJournal of Clinical Epidemiology, 2011
- There was evidence of convergent and construct validity of Physiotherapy Evidence Database quality scale for physiotherapy trialsJournal of Clinical Epidemiology, 2010
- The GRADE System for Rating Clinical GuidelinesPLOS Medicine, 2009
- Comparison of Registered and Published Primary Outcomes in Randomized Controlled TrialsJAMA, 2009
- Coefficient Kappa: Some Uses, Misuses, and AlternativesEducational and Psychological Measurement, 1981
- Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 1969
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960