Evidence‐Based Potential of Generative Artificial Intelligence Large Language Models on Dental Avulsion: ChatGPT Versus Gemini
Top Cited Papers
- 2 November 2024
- journal article
- research article
- Published by Wiley in Dental Traumatology
- Vol. 41 (2) , 178-186
Abstract
Background: In this study, the accuracy and comprehensiveness of the answers given to questions about dental avulsion by two artificial intelligence‐based language models, ChatGPT and Gemini, were comparatively evaluated.Materials and Methods: Based on the guidelines of the International Society of Dental Traumatology, a total of 33 questions were prepared, including multiple‐choice questions, binary questions, and open‐ended questions as technical questions and patient questions about dental avulsion. They were directed to ChatGPT and Gemini. Responses were recorded and scored by four pediatric dentists. Statistical analyses, including ICC analysis, were performed to determine the agreement and accuracy of the responses. The significance level was set as p < 0.050.Results: The mean score of the Gemini model was statistically significantly higher than the ChatGPT (p = 0.001). ChatGPT gave more correct answers to open‐ended questions and T/F questions on dental avulsion; it showed the lowest accuracy in the MCQ section. There was no significant difference between the responses of the Gemini model to different types of questions on dental avulsion and the median scores (p = 0.088). ChatGPT and Gemini were analyzed with the Mann–Whitney U test without making a distinction between question types, and Gemini answers were found to be statistically significantly more accurate (p = 0.004).Conclusions: The Gemini and ChatGPT language models based on the IADT guideline for dental avulsion undoubtedly show promise. To guarantee the successful incorporation of LLMs into practice, it is imperative to conduct additional research, clinical validation, and improvements to the models.Keywords
This publication has 44 references indexed in Scilit:
- The Quality of AI-Generated Dental Caries Multiple Choice Questions: A Comparative Analysis of ChatGPT and Google Bard Language ModelsHeliyon, 2024
- Evaluating the efficacy of leading large language models in the Japanese national dental hygienist examination: A comparative analysis of ChatGPT, Bard, and Bing ChatJournal of Dental Sciences, 2024
- ChatGPT 3.5 fails to write appropriate multiple choice practice exam questionsAcademic Pathology, 2023
- Can natural language processing serve as a consultant in oral surgery?Journal of Stomatology Oral and Maxillofacial Surgery, 2023
- Performance of Google bard and ChatGPT in mass casualty incidents triageThe American Journal of Emergency Medicine, 2023
- Can ChatGPT be used in oral and maxillofacial surgery?Journal of Stomatology Oral and Maxillofacial Surgery, 2023
- Impact of Artificial Intelligence-Based Chatbots on Customer Engagement and Business Growth2022
- Adopting artificial intelligence in dental education: A model for academic leadership and innovationJournal of Dental Education, 2022
- Artificial intelligence in marketing: Systematic review and future research directionInternational Journal of Information Management Data Insights, 2021
- Application and performance of artificial intelligence technology in forensic odontology – A systematic reviewLegal Medicine, 2021