Exploring Discrepancies between Protocols and Published Scoping Reviews in Implementation Science: Protocol for a Methodological Study
Open Access
- 28 August 2025
- journal article
- Published by F1000 Research Ltd in HRB Open Research
- Vol. 8, 95
Abstract
Background Discrepancies appear to be common between systematic reviews and their protocols, potentially undermining the credibility of their findings if discrepancies are not transparently reported. However, it is unclear to what extent such discrepancies also exist within scoping reviews, which may be more prone to such changes due to their greater flexibility. Scoping reviews are increasingly common within implementation science; biases in their conduct therefore may have detrimental effects to the real-world settings in which evidence is applied, in addition to undermining the scientific validity of the reviews in this growing discipline. This study aims to investigate discrepancies between scoping reviews and their protocols using reviews in the field of implementation science as an exemplar. In particular, the study will examine how common such discrepancies are, why they occur, and how they are reported in the literature. Methods This is a methodological study of completed scoping reviews on implementation science topics which will be gathered from five key journals: Implementation Science, Implementation Research and Practice, Implementation Science Communications, BMJ Quality and Safety, and JBI Evidence Implementation. Those with available protocols will be examined for discrepancies between their earliest protocol and their final report. Methodological details will be extracted from the protocols and reviews. These data will be coded to ascertain whether discrepancies are found, what aspect of the review these relate to, the extent of this change (e.g. major vs. minor), whether discrepancies are acknowledged and where this occurs in the paper, and any justification given for this change. The data extraction tool is in development, informed by relevant guidelines for conducting and reporting scoping reviews. Conclusions By understanding the extent, nature, and reasons for discrepancies in scoping reviews, findings can inform guidance for conducting such reviews, particularly when planning review protocols, and when reporting methodological discrepancies.Keywords
Funding Information
- Health Research Board (Ireland) and the HSC Public Health Agency (ESI-2021-001)
- University College Cork (RL-2020-004)
This publication has 30 references indexed in Scilit:
- Discrepancies in reported results between trial registries and journal articles for AI clinical researcheClinicalMedicine, 2025
- The role of scoping reviews in reducing research wasteJournal of Clinical Epidemiology, 2022
- Conducting high quality scoping reviews-challenges and solutionsJournal of Clinical Epidemiology, 2021
- Scoping reviews in health professions education: challenges, considerations and lessons learned about epistemology and methodologyAdvances in Health Sciences Education, 2019
- Inductive Content Analysis2019
- Comparison of non-Cochrane systematic reviews and their published protocols: differences occurred frequently but were seldom explainedJournal of Clinical Epidemiology, 2019
- More than one-third of systematic reviews did not fully report the adverse events outcomeJournal of Clinical Epidemiology, 2019
- A third of systematic reviews changed or did not specify the primary outcome: a PROSPERO register studyJournal of Clinical Epidemiology, 2016
- Empirical Evidence for Selective Reporting of Outcomes in Randomized TrialsJAMA, 2004
- Publishing Protocols of Systematic ReviewsJAMA, 2002