Comparison of the diagnostic accuracy of dentists and ChatGPT in jawbone lesions
Open Access
- 18 May 2026
- journal article
- Published by Springer Nature in BMC Oral Health
- Vol. 26 (1)
Abstract
Artificial intelligence (AI) is leading to a significant paradigm shift in medical imaging and diagnostic sciences. In particular, Chat Generative Pre-trained Transformer (ChatGPT) is finding increasing application in diagnostic processes due to its ability to generate clinical outcomes. This study aims to evaluate the diagnostic accuracy of ChatGPT for jawbone lesions and also to compare it with that of Oral and Maxillofacial Radiologists (OMFR), Oral and Maxillofacial Surgeons (OMFS), and general dentists. Thirty cases with jawbone lesions, for which clinical information, panoramic radiographs, and histopathological diagnoses were available, were selected. A questionnaire was prepared, including participants' (OMFR, OMFS, and general dentists) demographic information, the cases' clinical findings and panoramic radiographs, and distributed via electronic communication channels. The same cases were loaded into ChatGPT-4 and asked to generate a preliminary diagnosis. The data were statistically analyzed using the Wilcoxon Signed Rank, Mann-Whitney U, and Kruskal-Wallis tests at a significance level of p < 0.05. Overall, ChatGPT's diagnostic accuracy was limited to 46.67%, while the OMFR (67.71%) and OMFS (58.96%) groups had statistically significantly higher success rates (p < 0.05) than ChatGPT. General dentists (37.85%) had lower or similar diagnostic accuracy compared to ChatGPT in most subgroups (gender, age, workplace, professional experience). ChatGPT demonstrated moderate diagnostic accuracy. While OMFR and OMFS participants had significantly higher accuracy rates than ChatGPT, ChatGPT generally outperformed general dentists. These results indicate that such AI systems cannot replace specialist clinicians but can provide valuable contributions as supportive tools that enhance diagnosis.Keywords
This publication has 22 references indexed in Scilit:
- Comparative diagnostic accuracy of ChatGPT large language models and expert clinicians in complex oral and maxillofacial diseasesScientific Reports, 2026
- Diagnostic Performance of Large Language Models in Multimodal Analysis of Radiolucent Jaw LesionsInternational Dental Journal, 2025
- Evaluating AI-generated patient education materials for spinal surgeries: Comparative analysis of readability and DISCERN quality across ChatGPT and deepseek modelsInternational Journal of Medical Informatics, 2025
- Diagnostic performance of ChatGPT-4.0 in histopathological description analysis of oral and maxillofacial lesions: a comparative study with pathologistsOral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 2024
- Accuracy and consistency of ChatGPT-3.5 and − 4 in providing differential diagnoses in oral and maxillofacial diseases: a comparative diagnostic performance analysisClinical Oral Investigations, 2024
- Unveiling the risks of ChatGPT in diagnostic surgical pathologyVirchows Archiv, 2024
- ChatGPT in medicine: A cross-disciplinary systematic review of ChatGPT’s (artificial intelligence) role in research, clinical practice, education, and patient interactionMedicine, 2024
- Assessing the use of the novel tool Claude 3 in comparison to ChatGPT 4.0 as an artificial intelligence tool in the diagnosis and therapy of primary head and neck cancer casesEuropean Archives of Oto-Rhino-Laryngology, 2024
- Concordance of clinician, Chat-GPT4, and ORAD diagnoses against histopathology in Odontogenic Keratocysts and tumours: a 15-Year New Zealand retrospective studyOral and Maxillofacial Surgery, 2024
- Imaging of Radiolucent Jaw LesionsSeminars in Musculoskeletal Radiology, 2020