Innovating dental diagnostics: ChatGPT's accuracy on diagnostic challenges
Authors:
- 22 July 2024
- journal article
- research article
- Published by Wiley in Oral Diseases
- Vol. 31 (3) , 911-917
Abstract
Introduction: Complex patient diagnoses in dentistry require a multifaceted approach which combines interpretations of clinical observations with an in‐depth understanding of patient history and presenting problems. The present study aims to elucidate the implications of ChatGPT (OpenAI) as a comprehensive diagnostic tool in the dental clinic through examining the chatbot's diagnostic performance on challenging patient cases retrieved from the literature.Methods: Our study subjected ChatGPT3.5 and ChatGPT4 to descriptions of patient cases for diagnostic challenges retrieved from the literature. Sample means were compared using a two‐tailed t‐test, while sample proportions were compared using a two‐tailed χ2 test. A p‐value below the threshold of 0.05 was deemed statistically significant.Results: When prompted to generate their own differential diagnoses, ChatGPT3.5 and ChatGPT4 achieved a diagnostic accuracy of 40% and 62%, respectively. When basing their diagnostic processes on a differential diagnosis retrieved from the literature, ChatGPT3.5 and ChatGPT4 achieved a diagnostic accuracy of 70% and 80%, respectively.Conclusion: ChatGPT displays an impressive capacity to correctly diagnose complex diagnostic challenges in the field of dentistry. Our study paints a promising potential for the chatbot to 1 day serve as a comprehensive diagnostic tool in the dental clinic.Keywords
This publication has 11 references indexed in Scilit:
- Evaluation of the Performance of Generative AI Large Language Models ChatGPT, Google Bard, and Microsoft Bing Chat in Supporting Evidence-Based Dentistry: Comparative Mixed Methods StudyJournal of Medical Internet Research, 2023
- Beyond the Scalpel: Assessing ChatGPT's potential as an auxiliary intelligent virtual assistant in oral surgeryComputational and Structural Biotechnology Journal, 2023
- ChatGPT-Generated Differential Diagnosis Lists for Complex Case–Derived Clinical Vignettes: Diagnostic Accuracy EvaluationJMIR Medical Informatics, 2023
- The performance of artificial intelligence language models in board-style dental knowledge assessmentThe Journal of the American Dental Association, 2023
- ChatGPT for shaping the future of dentistry: the potential of multi-modal large language modelInternational Journal of Oral Science, 2023
- Diagnostic Performance of ChatGPT from Patient History and Imaging Findings on the Diagnosis Please QuizzesRadiology, 2023
- ChatGPT in Dentistry: A Comprehensive ReviewCureus, 2023
- Implications of large language models such as ChatGPT for dental medicineJournal of Esthetic and Restorative Dentistry, 2023
- Caries Detection on Intraoral Images Using Artificial IntelligenceJournal of Dental Research, 2021
- Artificial Intelligence and Clinical Decision Making: The New Nature of Medical UncertaintyAcademic Medicine, 2020