A systematic review of orthopaedic manual therapy randomized clinical trials quality
Open Access
- 9 February 2016
- journal article
- review article
- Published by Taylor & Francis in Journal of Manual & Manipulative Therapy
- Vol. 24 (5) , 241-252
Abstract
Study Design: Systematic review and meta-analysis. Objectives: To conduct a systematic review and meta-analysis of randomized clinical trials (RCTs) in the orthopaedic manual therapy (OMT) literature from January 2010 to June 2014 in order to determine if the CONSORT checklist and Cochrane Risk of Bias (RoB) assessment tools: (1) are reliable; (2) have improved the reporting and decreased the risk of bias in RCTs in the OMT literature; (3) differ based on journal impact factor (JIF); and (4) scores are associated with each other. Background: The CONSORT statement is used to improve the accuracy of reporting within RCTs. The Cochrane RoB tool was designed to assess the risk of bias within RCTs. To date, no evaluation of the quality of reporting and risk of bias in OMT RCTs has been published. Methods: Relevant RCTs were identified by a literature review from January 2010 to June 2014. The identified RCTs were assessed by two individual reviewers utilizing the 2010 CONSORT checklist and the RoB tool. Agreement and a mean composite total score for each tool were attained in order to determine if the CONSORT and RoB tools were reliable and varied by year and impact factor. Results: A total of 72 RCTs in the OMT literature were identified. A number of categories within the CONSORT and RoB tools demonstrated prevalence-adjusted bias-adjusted kappa (PABAK) scores of less than 0.20 and from 0.20 to 0.40. The total CONSORT and RoB scores were correlated to each other (r = 0.73; 95% CI 0.60 to 0.82; p < 0.0001). There were no statistically significant differences in CONSORT or RoB scores by year. There was a statistically significant correlation between both CONSORT scores and JIF (r = 0.64, 95% CI 0.47 to 0.76; p < 0.0001), and between RoB scores and JIF (r = 0.42, 95% confidence interval 0.21-0.60; p < 0.001). There was not a statistically significant correlation between JIF and year of publication. Conclusion: Our findings suggest that the CONSORT and RoB have a number of items that are unclear and unreliable, and that the quality of reporting in OMT trials has not improved in recent years. Improvements in reporting are necessary to allow advances in OMT practice. Level of Evidence: 1A.Keywords
This publication has 22 references indexed in Scilit:
- A systematic review of the quality of randomized controlled trials in head and neck oncology surgeryThe Laryngoscope, 2014
- Evaluation of the Cochrane Collaboration’s tool for assessing the risk of bias in randomized trials: focus groups, online survey, proposed recommendations and their implementationSystematic Reviews, 2014
- Evaluation of the Endorsement of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the Quality of Published Systematic Review and Meta-AnalysesPLOS ONE, 2013
- Testing the Risk of Bias tool showed low reliability between individual reviewers and across consensus assessments of reviewer pairsJournal of Clinical Epidemiology, 2013
- Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane reviewaSystematic Reviews, 2012
- 2009 Updated Method Guidelines for Systematic Reviews in the Cochrane Back Review GroupSpine, 2009
- Reconstruction of Galileo Galilei’s experiment: the inclined planePhysics Education, 2008
- The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized TrialsJAMA, 2001
- Improving the Quality of Reporting of Randomized Controlled TrialsJAMA, 1996
- Improving the quality of reporting of randomized controlled trials. The CONSORT statementJAMA, 1996