Examining labelling guidelines for AI‐based software as a medical device: A review and analysis of dermatology mobile applications in Australia
Open Access
- 1 May 2024
- journal article
- review article
- Published by Wiley in Australasian Journal of Dermatology
- Vol. 65 (5) , 409-422
Abstract
In recent years, there has been a surge in the development of AI‐based Software as a Medical Device (SaMD), particularly in visual specialties such as dermatology. In Australia, the Therapeutic Goods Administration (TGA) regulates AI‐based SaMD to ensure its safe use. Proper labelling of these devices is crucial to ensure that healthcare professionals and the general public understand how to use them and interpret results accurately. However, guidelines for labelling AI‐based SaMD in dermatology are lacking, which may result in products failing to provide essential information about algorithm development and performance metrics. This review examines existing labelling guidelines for AI‐based SaMD across visual medical specialties, with a specific focus on dermatology. Common recommendations for labelling are identified and applied to currently available dermatology AI‐based SaMD mobile applications to determine usage of these labels. Of the 21 AI‐based SaMD mobile applications identified, none fully comply with common labelling recommendations. Results highlight the need for standardized labelling guidelines. Ensuring transparency and accessibility of information is essential for the safe integration of AI into health care and preventing potential risks associated with inaccurate clinical decisions.Keywords
This publication has 40 references indexed in Scilit:
- Improving skin cancer management with ARTificial intelligence: A pre-post intervention trial of an artificial intelligence system used as a diagnostic aid for skin cancer management in a real-world specialist dermatology settingJournal of the American Academy of Dermatology, 2022
- Artificial intelligence and machine learning algorithms for early detection of skin cancer in community and primary care settings: a systematic reviewThe Lancet Digital Health, 2022
- Radiology artificial intelligence: a systematic review and evaluation of methods (RAISE)European Radiology, 2022
- FDA-regulated AI Algorithms: Trends, Strengths, and Gaps of Validation StudiesAcademic Radiology, 2022
- Checklist for Evaluation of Image-Based Artificial Intelligence Reports in DermatologyJAMA Dermatology, 2022
- Lack of Transparency and Potential Bias in Artificial Intelligence Data Sets and AlgorithmsJAMA Dermatology, 2021
- Risk of Bias and Error From Data Sets Used for Dermatologic Artificial IntelligenceJAMA Dermatology, 2021
- To buy or not to buy—evaluating commercial AI solutions in radiology (the ECLAIR guidelines)European Radiology, 2021
- Approval of artificial intelligence and machine learning-based medical devices in the USA and Europe (2015–20): a comparative analysisThe Lancet Digital Health, 2021
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017