Longitudinal analysis of reporting and quality of systematic reviews in high-impact surgical journals
- 21 December 2016
- journal article
- review article
- Published by Oxford University Press (OUP) in British Journal of Surgery
- Vol. 104 (3) , 198-204
Abstract
Background The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta‐Analyses) Statement aims to optimize the reporting of systematic reviews. The performance of the PRISMA Statement in improving the reporting and quality of surgical systematic reviews remains unclear. Methods Systematic reviews published in five high‐impact surgical journals between 2007 and 2015 were identified from online archives. Manuscripts blinded to journal, publication year and authorship were assessed according to 27 reporting criteria described by the PRISMA Statement and scored using a validated quality appraisal tool (AMSTAR, Assessing the Methodological Quality of Systematic Reviews). Comparisons were made between studies published before (2007–2009) and after (2011–2015) its introduction. The relationship between reporting and study quality was measured using Spearman's rank test. Results Of 281 eligible manuscripts, 80 were published before the PRISMA Statement and 201 afterwards. Most manuscripts (208) included a meta‐analysis, with the remainder comprising a systematic review only. There was no meaningful change in median compliance with the PRISMA Statement (19 (i.q.r. 16–21) of 27 items before versus 19 (17–22) of 27 after introduction of PRISMA) despite achieving statistical significance (P = 0·042). Better reporting compliance was associated with higher methodological quality (rs = 0·70, P < 0·001). Conclusion The PRISMA Statement has had minimal impact on the reporting of surgical systematic reviews. Better compliance was associated with higher‐quality methodology.Keywords
This publication has 16 references indexed in Scilit:
- The reporting quality of systematic reviews and meta-analyses in vascular surgery needs improvement: A systematic reviewInternational Journal of Surgery, 2014
- Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic reviewBMJ, 2014
- Methodology and reporting of meta-analyses in the neurosurgical literatureJournal of Neurosurgery, 2014
- Evaluation of the Endorsement of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the Quality of Published Systematic Review and Meta-AnalysesPLOS ONE, 2013
- Association of Study Quality with Completeness of Reporting: Have Completeness of Reporting and Quality of Systematic Reviews and Meta-Analyses in Major Radiology Journals Changed Since Publication of the PRISMA Statement?Radiology, 2013
- Reporting and Methodological Quality of Systematic Reviews in the Orthopaedic LiteratureJournal of Bone and Joint Surgery, 2013
- AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviewsJournal of Clinical Epidemiology, 2009
- Meta-analysis of Observational Studies in EpidemiologyA Proposal for ReportingJAMA, 2000
- Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statementThe Lancet, 1999
- Surgical research or comic opera: questions, but few answersThe Lancet, 1996