Calibrating CONSORT-AI with FAIR Principles to enhance reproducibility in AI-driven clinical trials
Authors:
- Kirubel Biruk ShiferawKSKirubel Biruk Shiferaw
- Irina BalaurIBIrina Balaur
- Gary CollinsGCGary Collins
- Curtis SharmaCSCurtis Sharma
- Leyla Jael CastroLCLeyla Jael Castro
- Fotis PsomopoulosFotis Psomopoulos
- Daniel GarijoDGDaniel Garijo
- Ron HenkelRHRon Henkel
- Dagmar WaltemathDWDagmar Waltemath
- Atinkut Alamirrew ZelekeAZAtinkut Alamirrew Zeleke
Preprint
Abstract
: Artificial intelligence (AI) is increasingly embedded in clinical trials, yet poor reproducibility remains a critical barrier to trustworthy and transparent research. In this study, we propose a structured calibration of the CONSORT-AI reporting guideline using the FAIR (Findable, Accessible, Interoperable, Reusable) principles. We introduce the application of CALIFRAME, a framework designed to evaluate and align existing medical AI reporting standards with FAIR-compliant practices. Applying CALIFRAME to the CONSORT-AI checklist reveals specific gaps in data and code sharing, metadata use, and accessibility practices in current AI-driven clinical trials. Our results underscore the need for standardized metadata, clear licensing, and stakeholder-inclusive design in medical AI reporting. We demonstrate that FAIR- oriented calibration of reporting guidelines can bridge the reproducibility gap and support more transparent, efficient, and reusable AI interventions in healthcare. This work advocates for a shift toward reproducibility as a foundation for trustworthy AI in clinical research.Keywords
This publication has 59 references indexed in Scilit:
- Implementing FAIR principles in data management systems: A multi-case study in precision farmingComputers and Electronics in Agriculture, 2024
- ISO/IEC quality standards for AI engineeringComputer Science Review, 2024
- Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelinesNature Communications, 2024
- Link-Rot in Web-Sourced Multimedia Datasets2023
- Hugging Face2022
- Randomized Clinical Trials of Machine Learning Interventions in Health CareJAMA Network Open, 2022
- Transparency and reproducibility in artificial intelligenceNature, 2020
- Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extensionThe Lancet Digital Health, 2020
- Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACEEcological Modelling, 2014
- The OBO Foundry: coordinated evolution of ontologies to support biomedical data integrationNature Biotechnology, 2007