Supporting Reanalysis and Reuse of Clinical Trial Data: A Case Study
Authors:
- Cora BurgwinkelCBCora Burgwinkel
- Han Chang ChiamHCHan Chang Chiam
- Ka Hin TaiKTKa Hin Tai
- Jifan WangJWJifan Wang
- Mian Haider AliMAMian Haider Ali
- Minoo MatbouriahiMMMinoo Matbouriahi
- Tobechi ObinwanneTOTobechi Obinwanne
- Grigorius PapapostolouGPGrigorius Papapostolou
- Muhammad RiedhaMRMuhammad Riedha
- Giulia VarvaraGVGiulia Varvara
- Yazid ZalaiYZYazid Zalai
Preprint
Abstract
Background: Reproducing published findings from clinical trials is a critical component of scientific transparency, yet it remains a challenging and under-practiced task. Despite increasing emphasis on reproducibility and data reuse in research policies, few real-world examples exist where independent teams have reproduced complex analyses using clinical trial data. In this case study, the aim was to independently reproduce the key findings of a high-impact clinical trial on rectal cancer treatment using shared trial data. Method: We organized a multi-team datathon, where each team was provided with the same dataset and supporting material, and was tasked to reproduce the results of the CAO/ARO/AIO-04 trial, with optional additional analysis. We contacted the original investigators for data access and reuse, and consulted them to understand the study, clinically and scientifically. Results: Five teams used R or Python to reproduce the statistical results, and the corresponding scripts can be found on Gitlab. All teams reproduced the analyses for primary outcome disease-free survival (DFS). The key findings on DFS were consistently reproduced, reinforcing confidence in the trial main conclusions. Result robustness was investigated using a different analytical software or statistical models. Nevertheless, challenges were encountered when the supplementary materials were not easily identified. Minor reporting issues were noticed in the reproduced paper. Conclusion: Reproduction of a major oncology clinical trial confirmed the reliability of its main conclusions. Divergences highlighted reporting gaps, such as incomplete protocols and broken links, that future trials should address. This case study demonstrates the value of systematic reproducibility checks for clinical research transparency and challenges in data sharing for reproducibility.Keywords
This publication has 30 references indexed in Scilit:
- Reusing clinical trial data to consolidate and advance medical knowledgeJournal of Clinical Epidemiology, 2025
- Improving the reporting and use of trial results in clinical trials registries: global practices, barriers, and recommendationsJournal of Clinical Epidemiology, 2025
- SPIRIT 2025 statement: updated guideline for protocols of randomised trialsThe Lancet, 2025
- CONSORT 2025 statement: updated guideline for reporting randomised trialsThe Lancet, 2025
- Reporting of Trial Registration Numbers in Publications of Vaccine Randomized Clinical TrialsJAMA Network Open, 2025
- Reproducibility of real-world evidence studies using clinical practice data to inform regulatory and coverage decisionsNature Communications, 2022
- Perspective on reducing errors in researchContemporary Clinical Trials Communications, 2021
- Development and Validation of a Natural Language Processing Tool to Generate the CONSORT Reporting Checklist for Randomized Clinical TrialsJAMA Network Open, 2020
- Notice of Retraction. Aboumatar et al. Effect of a Program Combining Transitional Care and Long-term Self-management Support on Outcomes of Hospitalized Patients With Chronic Obstructive Pulmonary Disease: A Randomized Clinical Trial. JAMA. 2018;320(22):2335-2343.JAMA, 2019
- Oxaliplatin added to fluorouracil-based preoperative chemoradiotherapy and postoperative chemotherapy of locally advanced rectal cancer (the German CAO/ARO/AIO-04 study): final results of the multicentre, open-label, randomised, phase 3 trialThe Lancet Oncology, 2015