On the limitations of large language models in clinical diagnosis
Preprint
Abstract
Objective: Large Language Models such as GPT-4 previously have been applied to differential diagnostic challenges based on published case reports. Published case reports have a sophisticated narrative style that is not readily available from typical electronic health records (EHR). Furthermore, even if such a narrative were available in EHRs, privacy requirements would preclude sending it outside the hospital firewall. We therefore tested a method for parsing clinical texts to extract ontology terms and programmatically generating prompts that by design are free of protected health information. Materials and Methods: We investigated different methods to prepare prompts from 75 recently published case reports. We transformed the original narratives by extracting structured terms representing phenotypic abnormalities, comorbidities, treatments, and laboratory tests and creating prompts programmatically. Results: Performance of all of these approaches was modest, with the correct diagnosis ranked first in only 5.3-17.6% of cases. The performance of the prompts created from structured data was substantially worse than that of the original narrative texts, even if additional information was added following manual review of term extraction. Moreover, different versions of GPT-4 demonstrated substantially different performance on this task. Discussion: The sensitivity of the performance to the form of the prompt and the instability of results over two GPT-4 versions represent important current limitations to the use of GPT-4 to support diagnosis in real-life clinical settings. Conclusion: Research is needed to identify the best methods for creating prompts from typically available clinical data to support differential diagnostics.Keywords
This publication has 20 references indexed in Scilit:
- Large language models in medicineNature Medicine, 2023
- Accuracy of a Generative Artificial Intelligence Model in a Complex Diagnostic ChallengeJAMA, 2023
- ChatGPT: a pioneering approach to complex prenatal differential diagnosisAmerican Journal of Obstetrics & Gynecology MFM, 2023
- Foundation models for generalist medical artificial intelligenceNature, 2023
- Case 26-2022: A 48-Year-Old Woman with Cystic Lung DiseaseNew England Journal of Medicine, 2022
- Self-supervised learning in medicine and healthcareNature Biomedical Engineering, 2022
- Case 38-2021: A 76-Year-Old Woman with Abdominal Pain, Weight Loss, and Memory ImpairmentNew England Journal of Medicine, 2021
- On the Dangers of Stochastic Parrots2021
- The Human Phenotype Ontology in 2021Nucleic Acids Research, 2020
- Semantic integration of clinical laboratory tests from electronic health records for deep phenotyping and biomarker discoverynpj Digital Medicine, 2019