Artificial intelligence chatbots and idiopathic pulmonary fibrosis: are they ready to inform patients?
Open Access
- 1 January 2026
- journal article
- Published by FapUNIFESP (SciELO) in Revista da Associação Médica Brasileira
- Vol. 72 (2) , e20251080
Abstract
SUMMARY OBJECTIVE: The aim of this study was to determine the quality, reliability, and readability of the responses provided by artificial intelligence chatbots about idiopathic pulmonary fibrosis. METHODS: The clinically relevant questions about idiopathic pulmonary fibrosis diagnosis, treatment, prognosis, and lifestyle management were submitted to four widely used artificial intelligence chatbots, including ChatGPT, Perplexity, Gemini, and Copilot. Responses were assessed by five clinicians based on readability, understandability, quality, and content reliability using standardized tools. RESULTS: The overall readability of chatbot-generated responses was low, corresponding to high educational requirements. Understandability ranged from moderate to good, whereas actionability remained moderate. Gemini produced the most readable and understandable outputs. Journal of the American Medical Association and Likert scores indicated limited source transparency but good guideline concordance. DISCERN analysis for the treatment question showed significant variation (p=0.003), with Perplexity achieving the highest total score. CONCLUSION: Although artificial intelligence chatbots offer rapid and accessible information, their readability and source reliability remain limited. These findings highlight the necessity of expert supervision and further model improvement before artificial intelligence chatbots can be safely integrated into patient education.Keywords
This publication has 19 references indexed in Scilit:
- Idiopathic Pulmonary Fibrosis (an Update) and Progressive Pulmonary Fibrosis in Adults: An Official ATS/ERS/JRS/ALAT Clinical Practice GuidelineAmerican Journal of Respiratory and Critical Care Medicine, 2022
- Idiopathic Pulmonary FibrosisNew England Journal of Medicine, 2018
- Unfavourable outcome of glucocorticoid treatment in suspected idiopathic pulmonary fibrosisRespirology, 2017
- Natural history of idiopathic pulmonary fibrosisRespiratory Medicine, 2015
- Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient informationPatient Education and Counseling, 2014
- Pulmonary Rehabilitation in Interstitial Lung DiseaseChest, 2009
- A Systematic Review of Patient Inflammatory Bowel Disease Information Resources on the World Wide WebAmerican Journal of Gastroenterology, 2007
- Who Searches the Internet for Health Information?Health Services Research, 2006
- DISCERN: an instrument for judging the quality of written consumer health information on treatment choices.Journal of Epidemiology and Community Health, 1999
- Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware.1997