Readability, reliability, and quality of kyphosis-related information provided by artificial intelligence chatbots: A cross-sectional study
Open Access
- 8 January 2026
- journal article
- Published by SAGE Publications in Digital Health
- Vol. 12
Abstract
Background: Artificial intelligence (AI) chatbots are increasingly used for health information dissemination. However, their effectiveness depends on the clarity, reliability, and quality of the content they deliver. This cross-sectional study aimed to evaluate the readability and reliability of kyphosis-related information provided by six major AI chatbots: ChatGPT, Gemini, Copilot, Perplexity, DeepSeek, and Grok. Methods: We selected the top 10 kyphosis-related questions from Google's “People also ask” section and submitted them to each chatbot. Readability was assessed using FKGL, FKRS, GFOG, SMOG, CL, ARI, and LW indices. Quality and reliability were evaluated using the DISCERN tool, JAMA benchmark, Global Quality Score (GQS), Ensuring Quality Information for Patients (EQIP), and a kyphosis-specific content score (KSC). Statistical analyses were performed using the Kruskal–Wallis and Mann–Whitney U tests. Results: No statistically significant difference was found among chatbots in FKGL, FKRS, SMOG, ARI, or GFOG scores. However, Perplexity had significantly higher DISCERN and EQIP scores, indicating superior content quality. All chatbots presented content at a readability level higher than the AMA-recommended sixth-grade level. While AI models provided more comprehensive and up-to-date information than traditional web sources, their outputs remained challenging for the average patient to comprehend. Conclusions: AI chatbots offer promising tools for disseminating health information about kyphosis but require significant improvements in readability. Expert-reviewed and patient-centered refinements are necessary to ensure accessibility and safety in digital health communication.Keywords
This publication has 36 references indexed in Scilit:
- Readability of Online Patient Education Materials on Adult Reconstruction Web SitesThe Journal of Arthroplasty, 2012
- Low Health Literacy and Health Outcomes: An Updated Systematic ReviewAnnals of Internal Medicine, 2011
- Readability of Spine-Related Patient Education Materials From Subspecialty Organization and Spine Practitioner WebsitesSpine, 2009
- Readability of the Patient Education Section of the AOFAS WebsiteFoot & Ankle International, 2009
- Readability of Online Patient Education Materials From the AAOS Web SiteClinical Orthopaedics and Related Research, 2008
- Readability of Patient Education Materials from the American Academy of Orthopaedic Surgeons and Pediatric Orthopaedic Society of North America Web SitesJournal of Bone and Joint Surgery, 2008
- A Systematic Review of Patient Inflammatory Bowel Disease Information Resources on the World Wide WebAmerican Journal of Gastroenterology, 2007
- Ensuring Quality Information for Patients: development and preliminary validation of a new instrument to improve the quality of written health care informationHealth Expectations, 2004
- DISCERN: an instrument for judging the quality of written consumer health information on treatment choices.Journal of Epidemiology and Community Health, 1999
- Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware.1997