Time-to-retraction and likelihood of evidence contamination (VITALITY Extension I): a retrospective cohort analysis
Authors:
Preprint
Abstract
Background: The number of problematic randomized clinical trials (RCTs) has risen sharply in recent decades, posing serious challenges to the integrity of the healthcare evidence ecosystem. Objective: To investigate whether retraction of problematic RCTs could reduce evidence contamination. Design: Retrospective cohort study Setting: A secondary analysis of the VITALITY Study database. Participants: 1,330 retracted RCTs with 847 systematic reviews. Measurements: The difference in the median number (and its interquartile, IQR) of contamination before and after retraction. The association between time-to-retraction and likelihood of evidence contamination. Results: Among these retracted RCTs, 426 led to evidence contamination, resulting in 1,106 contamination events (251 after retraction vs. 855 before retraction). The time interval between RCT publication and first contamination ranged from 0.2 to 30.9 years, with a median of 3.3 years (95% CI: 3.0 to 3.9). The median number of contaminated systematic reviews was lower after retraction than before retraction (0, IQR: 0 to 1 vs. 1, IQR: 1 to 2, P < 0.01). Compared with trials retracted more than 7.5 years after publication, those retracted between 1.0 and 1.8 years (OR = 0.70, 95% CI: 0.60 to 0.80) and retracted within 1.0 year (OR = 0.69, 95% CI: 0.60 to 0.80) were associated with lower likelihood of evidence contamination. Limitations: Only assessed contaminated systematic reviews with quantitative synthesis and limited to retracted RCTs. Conclusions: Retracting problematic RCTs can significantly reduce evidence contamination, and faster retraction was associated with less contamination. To safeguard the integrity of the evidence ecosystem, academic journals should act promptly in the retraction of problematic studies to minimize their downstream impact. Primary Funding Sources: The National Natural Science Foundation of China (72204003, 72574229)Keywords
This publication has 34 references indexed in Scilit:
- Inclusion of Retracted Studies in Systematic Reviews and Meta-Analyses of InterventionsJAMA Internal Medicine, 2025
- Risk-of-bias assessment using Cochrane's revised tool for randomized trials (RoB 2) was useful but challenging and resource-intensive: observations from a systematic reviewJournal of Clinical Epidemiology, 2023
- Identifying potentially excellent publications using a citation-based machine learning approachInformation Processing & Management, 2023
- Retracted randomized controlled trials were cited and not corrected in systematic reviews and clinical practice guidelinesJournal of Clinical Epidemiology, 2022
- Key concepts in clinical epidemiology: addressing and reporting sources of bias in randomized controlled trialsJournal of Clinical Epidemiology, 2022
- More consideration is needed for retracted non-Cochrane systematic reviews in medicine: a systematic reviewJournal of Clinical Epidemiology, 2021
- Correction to: The Boldt scandal still in need of action: the example of colloids 10 years after initial suspicion of fraudIntensive Care Medicine, 2020
- Systematic examination of pre‐ and post‐retraction citationsProceedings of the Association for Information Science and Technology, 2019
- Understanding and misunderstanding randomized controlled trialsSocial Science & Medicine, 2018
- Governing knowledge in the scientific community: Exploring the role of retractions in biomedicineResearch Policy, 2012