Potential Use of ChatGPT for Patient Information in Periodontology: A Descriptive Pilot Study
Authors:
Open Access
- 8 November 2023
- journal article
- research article
- Published by Springer Nature in Cureus
- Vol. 15 (11) , e48518
Abstract
Objectives The aim of this study is to evaluate the accuracy and completeness of the answers given by Chat Generative Pre-trained Transformer (ChatGPT) (OpenAI OpCo, LLC, San Francisco, CA), to the most frequently asked questions on different topics in the field of periodontology. Methods The 10 most frequently asked questions by patients about seven different topics (periodontal diseases, peri-implant diseases, tooth sensitivity, gingival recessions, halitosis, dental implants, and periodontal surgery) in periodontology were created by ChatGPT. To obtain responses, a set of 70 questions was submitted to ChatGPT, with an allocation of 10 questions per subject. The responses that were documented were assessed using two distinct Likert scales by professionals specializing in the subject of periodontology. The accuracy of the responses was rated on a Likert scale ranging from one to six, while the completeness of the responses was rated on a scale ranging from one to three. Results The median accuracy score for all responses was six, while the completeness score was two. The mean scores for accuracy and completeness were 5.50 ± 0.23 and 2.34 ± 0.24, respectively. It was observed that ChatGPT's responses to the most frequently asked questions by patients for information purposes in periodontology were at least "nearly completely correct" in terms of accuracy and "adequate" in terms of completeness. There was a statistically significant difference between subjects in terms of accuracy and completeness (P<0.05). The highest and lowest accuracy scores were peri-implant diseases and gingival recession, respectively, while the highest and lowest completeness scores were gingival recession and dental implants, respectively. Conclusions The utilization of large language models has become increasingly prevalent, extending its applicability to patients within the healthcare domain. While ChatGPT may not offer absolute precision and comprehensive results without expert supervision, it is apparent that those within the field of periodontology can utilize it as an informational resource, albeit acknowledging the potential for inaccuracies.Keywords
This publication has 19 references indexed in Scilit:
- ChatGPT and Other Large Language Models Are Double-edged SwordsRadiology, 2023
- ChatGPT in Clinical ToxicologyJMIR Medical Education, 2023
- Analysis of types of and language used in online information available to patients with periodontitisBritish Dental Journal, 2023
- Can advanced technologies help address the global increase in demand for specialized medical care and improve telehealth services?Journal of Telemedicine and Telecare, 2023
- Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language modelsPLOS Digital Health, 2023
- How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge AssessmentJMIR Medical Education, 2023
- ChatGPT is fun, but not an authorScience, 2023
- Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive studyJournal of Educational Evaluation for Health Professions, 2023
- Health information quality of websites on periodontologyJournal of Clinical Periodontology, 2017
- Simulations in the United States Medical Licensing ExaminationTM (USMLETM)Quality and Safety in Health Care, 2004