Assessing the certainty of the evidence in systematic reviews: importance, process, and use
Top Cited Papers
Open Access
- 31 August 2024
- journal article
- review article
- Published by Oxford University Press (OUP) in American Journal of Epidemiology
- Vol. 194 (6) , 1681-1686
Abstract
When interpreting results and drawing conclusions, authors of systematic reviews should consider the limitations of the evidence included in their review. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach provides a framework for the explicit consideration of the limitations of the evidence included in a systematic review, and for incorporating this assessment into the conclusions. Assessments of certainty of evidence are a methodological expectation of systematic reviews. The certainty of the evidence is specific to each outcome in a systematic review and can be rated as high, moderate, low, or very low. Because it will have an important impact, before assessing the certainty of evidence, reviewers must clarify the intent of their question: are they interested in causation or association. Serious concerns regarding limitations in the study design, inconsistency, imprecision, indirectness, and publication bias can decrease the certainty of the evidence. Using an example, this article describes and illustrates the importance and the steps for assessing the certainty of evidence and drawing accurate conclusions in a systematic review.Keywords
This publication has 18 references indexed in Scilit:
- When beauty is but skin deep: dealing with problematic studies in systematic reviewsCochrane Database of Systematic Reviews, 2021
- GRADE guidelines 26: informative statements to communicate the findings of systematic reviews of interventionsJournal of Clinical Epidemiology, 2020
- GRADE guidelines: 18. How ROBINS-I and other tools to assess risk of bias in nonrandomized studies should be used to rate the certainty of a body of evidenceJournal of Clinical Epidemiology, 2019
- A risk of bias instrument for non-randomized studies of exposures: A users' guide to its application in the context of GRADEEnvironment International, 2019
- The GRADE Working Group clarifies the construct of certainty of evidenceJournal of Clinical Epidemiology, 2017
- GRADE guidelines: 8. Rating the quality of evidence—indirectnessJournal of Clinical Epidemiology, 2011
- GRADE guidelines: 5. Rating the quality of evidence—publication biasJournal of Clinical Epidemiology, 2011
- GRADE guidelines: 7. Rating the quality of evidence—inconsistencyJournal of Clinical Epidemiology, 2011
- GRADE guidelines: 9. Rating up the quality of evidenceJournal of Clinical Epidemiology, 2011
- GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)Journal of Clinical Epidemiology, 2011