Chatbots in medicine: certification process and applied use case
Open Access
- 1 October 2024
- journal article
- Published by SMW Supporting Association in Swiss Medical Weekly
- Vol. 154 (10) , 3954
Abstract
Chatbots are computer programs designed to engage in natural language conversations in an easy and understandable way. Their use has been accelerated recently with the advent of large language models. However, their application in medicine and healthcare has been limited due to concerns over data privacy, ther risk of providing medical diagnoses, and ensuring regulatory and legal compliance. Medicine and healthcare could benefit from chatbots if their scope is carefully defined and if they are used appropriately and monitored long-term. The confIAnce chatbot, developed at the Geneva University Hospitals and the University of Geneva, is an informational tool aimed at providing simplified information to the general public about primary care and chronic diseases. In this paper, we describe the certification and regulatory aspects applicable to chatbots in healthcare, particularly in primary care medicine. We use the confIAnce chatbot as a case study to explore the definition and classification of a medical device and its application to chatbots, considering the applicable Swiss regulations and the European Union AI Act. Chatbots can be classified anywhere from non-medical devices (informational tools that do not handle patient data or provide recommendations for treatment or diagnosis) to Class III medical devices (high-risk tools capable of predicting potentially fatal events and enabling a pre-emptive medical intervention). Key considerations in the definition and certification process include defining the chatbot’s scope, ensuring compliance with regulations, maintaining security and safety, and continuously evaluating performance, risks, and utility. A lexicon of relevant terms related to artificial intelligence in healthcare, medical devices, and regulatory frameworks is also presented in this paper. Chatbots hold potential for both patients and healthcare professionals, provided that their scope of practice is clearly defined, and that they comply with regulatory requirements. This review aims to provide transparency by outlining the steps required for certification and regulatory compliance, making it valuable for healthcare professionals, scientists, developers, and patients.Keywords
Funding Information
- Fondation privée des Hôpitaux universitaires de Genève
This publication has 20 references indexed in Scilit:
- A systematic review of artificial intelligence-powered (AI-powered) chatbot intervention for managing chronic illnessAnnals of Medicine, 2024
- Medical AI chatbots: are they safe to talk to patients?Nature Medicine, 2023
- A Pilot Program Utilising a “Chatbot “ to Support Patients in the First 30 Days Following an Admission to Hospital With Acute Decompensated Heart FailureHeart, Lung and Circulation, 2023
- Large language models in medicineNature Medicine, 2023
- The imperative for regulatory oversight of large language models (or generative AI) in healthcarenpj Digital Medicine, 2023
- Comparison of the international regulations for medical devices–USA versus EuropeInjury, 2023
- Effectiveness of using a chatbot to promote adherence to home physiotherapy after total knee replacement, rationale and design of a randomized clinical trialBMC Musculoskeletal Disorders, 2023
- Developing a Chatbot–Clinician Model for Hypertension ManagementNEJM Catalyst, 2022
- The Electronic Health Record Inbox: Recommendations for ReliefJournal of General Internal Medicine, 2022
- Assessing the impact of the COVID-19 pandemic on clinician ambulatory electronic health record useJournal of the American Medical Informatics Association, 2021