Guidelines, Consensus Statements, and Standards for the Use of Artificial Intelligence in Medicine: Systematic Review
Open Access
- 22 November 2023
- journal article
- review article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25 (1) , e46089
Abstract
Background: The application of artificial intelligence (AI) in the delivery of health care is a promising area, and guidelines, consensus statements, and standards on AI regarding various topics have been developed. Objective: We performed this study to assess the quality of guidelines, consensus statements, and standards in the field of AI for medicine and to provide a foundation for recommendations about the future development of AI guidelines. Methods: We searched 7 electronic databases from database establishment to April 6, 2022, and screened articles involving AI guidelines, consensus statements, and standards for eligibility. The AGREE II (Appraisal of Guidelines for Research & Evaluation II) and RIGHT (Reporting Items for Practice Guidelines in Healthcare) tools were used to assess the methodological and reporting quality of the included articles. Results: This systematic review included 19 guideline articles, 14 consensus statement articles, and 3 standard articles published between 2019 and 2022. Their content involved disease screening, diagnosis, and treatment; AI intervention trial reporting; AI imaging development and collaboration; AI data application; and AI ethics governance and applications. Our quality assessment revealed that the average overall AGREE II score was 4.0 (range 2.2-5.5; 7-point Likert scale) and the mean overall reporting rate of the RIGHT tool was 49.4% (range 25.7%-77.1%). Conclusions: The results indicated important differences in the quality of different AI guidelines, consensus statements, and standards. We made recommendations for improving their methodological and reporting quality. Trial Registration: PROSPERO International Prospective Register of Systematic Reviews (CRD42022321360); https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=321360Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Robo-writers: the rise and risks of language-generating AINature, 2021
- Welcoming new guidelines for AI clinical researchNature Medicine, 2020
- Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI ExtensionBMJ, 2020
- MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health careJournal of the American Medical Informatics Association, 2020
- Evidence-based Canadian guidelines for tele-retina screening for diabetic retinopathy: recommendations from the Canadian Retina Research Network (CR2N) Tele-Retina Steering CommitteeCanadian Journal of Ophthalmology, 2020
- International evaluation of an AI system for breast cancer screeningNature, 2020
- Advanced imaging for detection and differentiation of colorectal neoplasia: European Society of Gastrointestinal Endoscopy (ESGE) Guideline – Update 2019Endoscopy, 2019
- Artificial intelligence and breast screening: French Radiology Community position paperDiagnostic and Interventional Imaging, 2019
- Methodological and reporting quality of systematic reviews referenced in the clinical practice guideline for pediatric high-blood pressureJournal Of Hypertension, 2019
- With an eye to AI and autonomous diagnosisnpj Digital Medicine, 2018