Evaluating ChatGPT as a Patient Education Tool: Insights on Quality, Readability, and Reliability for Trigger Finger FAQs
Open Access
- 12 January 2026
- journal article
- Published by LookUs Bilisim A.S. in Medical Records
- No. 1
Abstract
Aim: Trigger finger (TF), or stenosing tenosynovitis, causes pain, snapping, and finger locking. It greatly affects patients' quality of life, prompting frequent inquiries to healthcare providers. ChatGPT, an AI language model, has gained popularity as a tool for patient education. This study evaluated the quality, readability, and usability of ChatGPT’s responses to common TF FAQs.Methods A set of FAQs regarding TF was developed based on reputable sources such as WebMD, Mayo Clinic, and NHS Trusts. Two experienced surgeons reviewed and refined the questions before submitting them to ChatGPT-4 for response generation. The quality of the responses was evaluated using the Global Quality Score (GQS) and DISCERN scale, while readability was assessed using the Flesch Reading Ease Score (FRES) and Flesch–Kincaid Grade Level (FKGL). Inter-rater reliability was determined using Cohen’s Kappa.Results: Twenty responses were evaluated, yielding a mean GQS of 3.8, indicating moderate to high quality (SD = 0.71). DISCERN scores averaged 37.08 ± 7.64, reflecting fair to good quality. Readability analysis showed a FRES score of 43.40, suggesting the content is challenging for those without a college education. The mean FKGL was 12.17, indicating advanced reading requirements. Prognosis-related questions had better readability scores than treatment-related responses, which were more complex. Conclusion: ChatGPT shows promise for patient education with moderate to high-quality responses about TF. However, advanced reading levels may limit wider accessibility. Improving readability and tailoring responses to diverse needs are vital for effectiveness. Human oversight is essential to ensure accuracy and usability of AI-generated content.Keywords
This publication has 18 references indexed in Scilit:
- Large Language Models in the Diagnosis of Hand and Peripheral Nerve Injuries: An Evaluation of ChatGPT and the Isabel Differential Diagnosis GeneratorJournal of Hand Surgery Global Online, 2024
- Artificial Intelligence-Powered Hand Surgery Consultation: GPT-4 as an Assistant in a Hand Surgery Outpatient ClinicThe Journal of Hand Surgery, 2024
- Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancyScientific Reports, 2024
- ChatGPT Responses to Common Questions About Anterior Cruciate Ligament Reconstruction Are Frequently SatisfactoryArthroscopy, 2023
- Can AI Think Like a Plastic Surgeon? Evaluating GPT-4’s Clinical Judgment in Reconstructive Procedures of the Upper ExtremityPlastic and Reconstructive Surgery - Global Open, 2023
- Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research ScenariosJournal of Medical Systems, 2023
- Steroid Injection Versus NSAID Injection for Trigger Finger: A Comparative Study of Early OutcomesThe Journal of Hand Surgery, 2012
- Trigger finger: etiology, evaluation, and treatmentCurrent Reviews in Musculoskeletal Medicine, 2007
- Trust and Sources of Health InformationArchives of internal medicine (1960), 2005
- A new readability yardstick.Journal of Applied Psychology, 1948