Comparing diagnostic skills in endodontic cases: dental students versus ChatGPT-4o
Top Cited Papers
Open Access
- 29 March 2025
- journal article
- research article
- Published by Springer Nature in BMC Oral Health
- Vol. 25 (1) , 1-8
Abstract
Artificial intelligence (AI) technologies have revolutionized fields such as economics, law, and healthcare. Large language models, like ChatGPT, have shown significant potential in dentistry, supporting diagnostic accuracy, treatment planning, and education. However, earlier versions of ChatGPT were limited to text-based data. The latest multimodal model, ChatGPT-4o, introduced in 2024, now processes text, images, audio, and video, enabling broader applications in clinical education. This study evaluates ChatGPT-4o’s diagnostic accuracy in endodontic cases, comparing it with dental students’ performance. This study included two groups of dental students: 3rd-year and 5th-year, alongside ChatGPT-4o. Participants answered 15 multiple-choice questions designed using radiographs, clinical photographs, and patient histories. These questions, based on the American Association of Endodontists’ Clinical Guidelines, were administered via Google Forms for students and ChatGPT-4o. Responses were categorized as correct, incorrect, or unanswered. Data were analyzed statistically. ChatGPT-4o demonstrated a higher accuracy rate and lower error rate compared to students, with 91.4% correct and 8.2% incorrect responses. Third-year students had a correct response rate of 60.8%, while fifth-year students achieved 79.5%. A statistically significant difference was found between the study groups in terms of correct response rates (p < 0.05), with ChatGPT outperforming both student groups (p < 0.001). Additionally, fifth-year students showed a higher correct response rate compared to third-year students. ChatGPT-4o demonstrates significant potential as a diagnostic support tool in dental education, particularly in endodontics. Its high diagnostic accuracy and consistency highlight its value as an innovative ( application in clinical training and decision-making.Keywords
This publication has 38 references indexed in Scilit:
- Predicting case difficulty in endodontic microsurgery using machine learning algorithmsJournal of Dentistry, 2023
- The Role of ChatGPT, Generative Language Models, and Artificial Intelligence in Medical Education: A Conversation With ChatGPT and a Call for PapersJMIR Medical Education, 2023
- How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge AssessmentJMIR Medical Education, 2023
- Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive studyJournal of Educational Evaluation for Health Professions, 2023
- Artificial Intelligence in Dentistry: Past, Present, and FutureCureus, 2022
- Detection of Dental Apical Lesions Using CNNs on Periapical RadiographSensors, 2021
- Artificial Intelligence in Endodontics: Current Applications and Future DirectionsJournal of Endodontics, 2021
- A call to action: concerns related to artificial intelligenceOral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 2021
- Artificial Intelligence in Dentistry: Chances and ChallengesJournal of Dental Research, 2020
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977