Quality of AI-generated temporomandibular disorder information: A comparative analysis based on Turkish patient queries
- 26 May 2026
- journal article
- Published by Taylor & Francis in Cranio®
- p. 1-8
Abstract
This study aims to evaluate the accuracy and quality of responses generated by large language model-based chatbots to frequently asked questions related to temporomandibular disorders (TMD). Ten questions were selected based on the most common inquiries made by patients with TMD to artificial intelligence (AI) chatbots. The responses of four widely used AI chatbots (ChatGPT Pro, ChatGPT 3.5, Deepseek, Grok3.0) were collected. Three expert evaluators assessed each chatbot's response using a modified Global Quality Scale (GQS). A statistically significant difference was observed among the four AI chatbots (p = 0.0097; η² = 0.09). ChatGPT Pro and Grok achieved significantly higher GQS scores than DeepSeek (p = 0.037*). While some AI chatbots show potential in answering TMD-related patient questions, variability in accuracy and reliability currently limits their use in clinical settings. Further training and validation are needed before integration into patient education or clinical decision-support systems.Keywords
This publication has 26 references indexed in Scilit:
- Can Chatbots Provide Accurate and Readable Information for Patients With Temporomandibular Disorders?Journal of Oral and Maxillofacial Surgery, 2025
- People Overtrust AI-Generated Medical Advice despite Low AccuracyNEJM AI, 2025
- Bracing: The hidden side of the moonCranio®, 2025
- Performance of the ChatGPT-3.5, ChatGPT-4, and Google Gemini large language models in responding to dental implantology inquiriesThe Journal of Prosthetic Dentistry, 2025
- Temporomandibular disorders: INfORM/IADR key points for good clinical practice based on standard of careCranio®, 2024
- Awake bruxism behaviors frequency in a group of healthy young adults with different psychological scoresCranio®, 2024
- Evaluation of AI-generated responses by different artificial intelligence chatbots to the clinical decision-making case-based questions in oral and maxillofacial surgeryOral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 2024
- A comparative analysis of AI-based chatbots: Assessing data quality in orthognathic surgery related patient informationJournal of Stomatology Oral and Maxillofacial Surgery, 2023
- Prevalence of temporomandibular joint disorders: a systematic review and meta-analysisClinical Oral Investigations, 2021
- Posturography as a diagnostic aid in dentistry: a systematic reviewJournal of Oral Rehabilitation, 2009