The Role of Artificial Intelligence Model Documentation in Translational Science: Scoping Review (Preprint)
Preprint
- 25 January 2023
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Despite the touted potential of artificial intelligence (AI) and machine learning (ML) to revolutionize health care, clinical decision support tools, herein referred to as medical modeling software (MMS), have yet to realize the anticipated benefits. One proposed obstacle is the acknowledged gaps in AI translation. These gaps stem partly from the fragmentation of processes and resources to support MMS transparent documentation. Consequently, the absence of transparent reporting hinders the provision of evidence to support the implementation of MMS in clinical practice, thereby serving as a substantial barrier to the successful translation of software from research settings to clinical practice. OBJECTIVE This study aimed to scope the current landscape of AI- and ML-based MMS documentation practices and elucidate the function of documentation in facilitating the translation of ethical and explainable MMS into clinical workflows. METHODS A scoping review was conducted in accordance with PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. PubMed was searched using Medical Subject Headings key concepts of AI, ML, ethical considerations, and explainability to identify publications detailing AI- and ML-based MMS documentation, in addition to snowball sampling of selected reference lists. To include the possibility of implicit documentation practices not explicitly labeled as such, we did not use documentation as a key concept but as an inclusion criterion. A 2-stage screening process (title and abstract screening and full-text review) was conducted by 1 author. A data extraction template was used to record publication-related information; barriers to developing ethical and explainable MMS; available standards, regulations, frameworks, or governance strategies related to documentation; and recommendations for documentation for papers that met the inclusion criteria. RESULTS Of the 115 papers retrieved, 21 (18.3%) papers met the requirements for inclusion. Ethics and explainability were investigated in the context of AI- and ML-based MMS documentation and translation. Data detailing the current state and challenges and recommendations for future studies were synthesized. Notable themes defining the current state and challenges that required thorough review included bias, accountability, governance, and explainability. Recommendations identified in the literature to address present barriers call for a proactive evaluation of MMS, multidisciplinary collaboration, adherence to investigation and validation protocols, transparency and traceability requirements, and guiding standards and frameworks that enhance documentation efforts and support the translation of AI- and ML-based MMS. CONCLUSIONS Resolving barriers to translation is critical for MMS to deliver on expectations, including those barriers identified in this scoping review related to bias, accountability, governance, and explainability. Our findings suggest that transparent strategic documentation, aligning translational science and regulatory science, will support the translation of MMS by coordinating communication and reporting and reducing translational barriers, thereby furthering the adoption of MMS.Keywords
All Related Versions
- Published version: Interactive Journal of Medical Research, 12 (1), e45903.
This publication has 36 references indexed in Scilit:
- A Road Map for Translational Research on Artificial Intelligence in Medical Imaging: From the 2018 National Institutes of Health/RSNA/ACR/The Academy WorkshopJournal of the American College of Radiology, 2019
- Strategies to reduce diagnostic errors: a systematic reviewBMC Medical Informatics and Decision Making, 2019
- Governance of automated image analysis and artificial intelligence analytics in healthcareClinical Radiology, 2019
- Cloning and characterization of the putative AFAP1-AS1 promoter regionJournal of Cancer, 2019
- PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and ExplanationAnnals of Internal Medicine, 2018
- Artificial intelligence as a medical device in radiology: ethical and regulatory issues in Europe and the United StatesInsights into Imaging, 2018
- Does Machine Learning Automate Moral Hazard and Error?American Economic Review, 2017
- Correction: World Health Organization Estimates of the Global and Regional Disease Burden of 22 Foodborne Bacterial, Protozoal, and Viral Diseases, 2010: A Data SynthesisPLOS Medicine, 2015
- Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sourcesBMJ, 2005
- Medical Records That Guide and TeachNew England Journal of Medicine, 1968