Ethical Application of Generative Artificial Intelligence in Medicine
- 14 December 2024
- journal article
- Published by Wiley in Arthroscopy
- Vol. 41 (4) , 874-885
Abstract
Generative artificial intelligence (AI) may revolutionize health care, providing solutions that range from enhancing diagnostic accuracy to personalizing treatment plans. However, its rapid and largely unregulated integration into medicine raises ethical concerns related to data integrity, patient safety, and appropriate oversight. One of the primary ethical challenges lies in generative AI’s potential to produce misleading or fabricated information, posing risks of misdiagnosis or inappropriate treatment recommendations, which underscore the necessity for robust physician oversight. Transparency also remains a critical concern, as the closed‐source nature of many large‐language models prevents both patients and health care providers from understanding the reasoning behind AI‐generated outputs, potentially eroding trust. The lack of regulatory approval for AI as a medical device, combined with concerns around the security of patient‐derived data and AI‐generated synthetic data, further complicates its safe integration into clinical workflows. Furthermore, synthetic datasets generated by AI, although valuable for augmenting research in areas with scarce data, complicate questions of data ownership, patient consent, and scientific validity. In addition, generative AI’s ability to streamline administrative tasks risks depersonalizing care, further distancing providers from patients. These challenges compound the deeper issues plaguing the health care system, including the emphasis of volume and speed over value and expertise. The use of generative AI in medicine brings about mass scaling of synthetic information, thereby necessitating careful adoption to protect patient care and medical advancement. Given these considerations, generative AI applications warrant regulatory and critical scrutiny. Key starting points include establishing strict standards for data security and transparency, implementing oversight akin to institutional review boards to govern data usage, and developing interdisciplinary guidelines that involve developers, clinicians, and ethicists. By addressing these concerns, we can better align generative AI adoption with the core foundations of humanistic health care, preserving patient safety, autonomy, and trust while harnessing AI’s transformative potential. Level of Evidence: Level V, expert opinion.Keywords
This publication has 106 references indexed in Scilit:
- Generative AI in Health Care and Liability Risks for Physicians and Safety Concerns for PatientsJAMA, 2023
- AI Chatbots, Health Privacy, and Challenges to HIPAA ComplianceJAMA, 2023
- Accuracy of a Generative Artificial Intelligence Model in a Complex Diagnostic ChallengeJAMA, 2023
- Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media ForumJAMA Internal Medicine, 2023
- AI-Generated Medical Advice—GPT and BeyondJAMA, 2023
- Appropriateness of Cardiovascular Disease Prevention Recommendations Obtained From a Popular Online Chat-Based Artificial Intelligence ModelJAMA, 2023
- Unintended Consequences of Machine Learning in MedicineJAMA, 2017
- Medical Professionalism in a Commercialized Health Care MarketJAMA, 2007
- Communicating Evidence for Participatory Decision MakingJAMA, 2004
- The Metamorphosis of Medical EthicsJAMA, 1993