Trustworthiness assessment as an inclusion criterion for systematic reviews—What is the impact on results?
Open Access
- 13 December 2023
- journal article
- review article
- Published by Wiley in Cochrane Evidence Synthesis and Methods
- Vol. 1 (10)
Abstract
Background: There is increasing concern that a significant proportion of randomized controlled trials (RCTs) included in Cochrane reviews may not be trustworthy. Applying the Cochrane Pregnancy and Childbirth Trustworthiness Screening Tool (CPC‐TST) has already had a clinically important effect on several reviews published by the Cochrane Pregnancy and Childbirth Group. Objectives: We wanted to assess the impact of removing untrustworthy RCTs from already‐published Cochrane reviews on a defined clinical area (antenatal and postnatal nutritional interventions). Methods: We applied the tool to 18 Cochrane reviews (374 RCTs). The tool had four domains: (i) is the research governance trustworthy; (ii) are the baseline characteristics trustworthy; (iii) is the study feasible; (iv) are the results plausible? When additional information was needed, authors were contacted using a standard template. At least two attempts were made to contact the authors. At the end of the evaluation process each study was classified as: (i) included (YES to all questions); (ii) excluded (retracted study); or (iii) awaiting classification (any NO to the questions). Results: Ninety‐three out of 374 included studies (25%) were reclassified as “excluded” or “awaiting classification.” The number of included RCTs was reduced in 14 out of 18 reviews. Six reviews (33%) were judged to require updating because of important differences in the Summary of Findings tables (direction and size of effects and/or GRADE ratings), conclusions, implication for practice, and/or implication for research. Conclusions: Formal assessment of trustworthiness, and inclusion only of studies that satisfy prespecified criteria for trustworthiness, affect conclusions in a relatively large number of Cochrane reviews, with potentially important clinical implications for practice and research.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Multiple-micronutrient supplementation for women during pregnancyCochrane Database of Systematic Reviews, 2019
- Data fabrication and other reasons for non‐random sampling in 5087 randomised, controlled trials in anaesthetic and general medical journalsAnaesthesia, 2017
- Iodine supplementation for women during the preconception, pregnancy and postpartum periodCochrane Database of Systematic Reviews, 2017
- Vitamin A supplementation for postpartum womenCochrane Database of Systematic Reviews, 2016
- Effects and safety of periconceptional oral folate supplementation for preventing birth defectsCochrane Database of Systematic Reviews, 2015
- Intermittent oral iron supplementation during pregnancyCochrane Database of Systematic Reviews, 2015
- Treatment for women with postpartum iron deficiency anaemiaCochrane Database of Systematic Reviews, 2015
- Supplementation with long chain polyunsaturated fatty acids (LCPUFA) to breastfeeding mothers for improving child growth and developmentCochrane Database of Systematic Reviews, 2015
- Multiple micronutrient powders for home (point-of-use) fortification of foods in pregnant womenCochrane Database of Systematic Reviews, 2015
- Calcium supplementation (other than for preventing or treating hypertension) for improving pregnancy and infant outcomesCochrane Database of Systematic Reviews, 2015