Caution is necessary in interpreting musculoskeletal physiotherapy intervention outcomes: a methodological review of physiotherapy neuromusculoskeletal reviews
- 14 February 2025
- journal article
- review article
- Published by Taylor & Francis in Journal of Manual & Manipulative Therapy
- Vol. 33 (3) , 236-252
Abstract
The physiotherapy literature lacks high-quality, registered systematic reviews (SRs) and 'trustworthy' randomized controlled trials (RCTs). It is unknown whether considering quality and 'trustworthiness' impact publication bias, heterogeneity, and the certainty of clinical recommendations observed in the literature. We performed a methodological review of SRs investigating physiotherapy treatment of neuromusculoskeletal conditions indexed by MEDLINE, between 1 January 2018, and 25 October 2023. Blinded reviewers examined the prospective intent and quality of SRs and the 'trustworthiness' of RCTs included therein. Blinded reviewers extracted data for the variables of interest (Numeric Pain Rating Scale and Visual Analog Scale). Of the SRs identified (N = 677), 13 were included in the final review. These included a total of 109 RCTs, including duplicates. Only eight of these trials were deemed 'trustworthy.' Publication bias was identified, and heterogeneity across the trials (N = 55) included in the quantitative analysis was high (I2 = 80.11%, 95% CI [75.88, 83.60]). Publication bias and heterogeneity were eliminated (I2 = 0%, 95% CI [0.00, 37.44]) upon considering those prospectively registered (N = 14). Statistical significance, assessed via the p-value at baseline (<.001), was eliminated (p = .746) once prospective, external, and internal validity was considered. Statistical inference through estimation, evaluated via effect size, confidence intervals, and minimal detectable change, was not present at baseline and reduced throughout the screening process. Trials of musculoskeletal interventions to manage pain in patients with neuromusculoskeletal conditions lack certainty and confidence in their treatment effects and exhibit high heterogeneity. Statistically significant effects and heterogeneity are eliminated when considering 'trustworthy' quality evidence. Consistent with previous findings, null effects, and low heterogeneity arise when considering the best available evidence. Meaningful effects are likely rare when assessed holistically using statistical inference through estimation and the confidence and certainty of the estimated effect.Keywords
This publication has 69 references indexed in Scilit:
- Trials We Cannot Trust: Investigating Their Impact on Systematic Reviews and Clinical Guidelines in Spinal PainThe Journal of Pain, 2023
- The effectiveness of hip interventions in patients with low-back pain: A systematic review and meta-analysisBrazilian Journal of Physical Therapy, 2023
- Searching two or more databases decreased the risk of missing relevant studies: a metaresearch studyJournal of Clinical Epidemiology, 2022
- Research Note: In a meta-analysis, the I index does not tell us how much the effect size varies across studiesJournal of Physiotherapy, 2020
- Showing confidence (intervals)Brazilian Journal of Physical Therapy, 2019
- The effectiveness of dry needling for patients with orofacial pain associated with temporomandibular dysfunction: a systematic review and meta-analysisBrazilian Journal of Physical Therapy, 2019
- Testing for funnel plot asymmetry of standardized mean differencesResearch Synthesis Methods, 2018
- A low proportion of systematic reviews in physical therapy are registered: a survey of 150 published systematic reviewsBrazilian Journal of Physical Therapy, 2018
- PRESS Peer Review of Electronic Search Strategies: 2015 Guideline StatementJournal of Clinical Epidemiology, 2016
- Kinesio Taping to generate skin convolutions is not better than sham taping for people with chronic non-specific low back pain: a randomised trialJournal of Physiotherapy, 2014