Evaluation of physicians’ opinions on receiving health information from ChatGPT; trustworthiness, value, and danger
- 18 December 2025
- journal article
- Published by SAGE Publications in Health Services Management Research
Abstract
This study assesses physicians’ perspectives on the role of ChatGPT in providing health-related information, highlighting its reliability, contributions and potential risks. In a survey of 88 physicians who were selected using convenience sampling, ChatGPT’s answers to three different health questions were evaluated, and reliability, benefits and potential hazards were rated on a scale of 1-10. The physicians were then asked about the rationale behind their evaluation scores. The qualitative assessments of the physicians were evaluated together with quantitative analyses of the scores. The results showed high trustworthiness scores across all questions (mean scores of 8.4, 8.2 and 8.6 over 10) and non-significant difference between questions, as well as significant benefits in promoting health literacy through general health advice and lifestyle recommendations (mean scores of 7.3, 7.9 and 8.3). Answer for lowering cholesterol was evaluated at at higher level of contribution than first question (p = 0.0004). However, concerns were raised about risks, particularly due to more direct answers including treatment recommendations, and the potential for misuse by patients was noted (mean scores of 2.6, 3.5 and 2.5). Second question (the treatment for atrial fibration) was evaluated at a higher level of risk (p = 0.002). While ChatGPT has the potential to be an effective tool for health education and promotion, this study underlines the importance of increasing users’ health literacy and establishing guidelines to ensure safe and ethical use. The findings highlight the need for multi-stakeholder approaches to optimise the integration of ChatGPT into healthcare settings.Keywords
This publication has 15 references indexed in Scilit:
- Comparing Performances of Artificial Intelligence Chatbots to Patients’ Questions on Health Information: Comprehensiveness, Accuracy and CurrencyJournal of Consumer Health on the Internet, 2024
- What if your patient switches from Dr. Google to Dr. ChatGPT? A vignette-based survey of the trustworthiness, value, and danger of ChatGPT-generated responses to health questionsEuropean Journal of Cardiovascular Nursing, 2023
- Role of Chat GPT in Public HealthAnnals of Biomedical Engineering, 2023
- Artificial Intelligence in Medicine & ChatGPT: De-Tether the PhysicianJournal of Medical Systems, 2023
- ChatGPT and antimicrobial advice: the end of the consulting infection doctor?The Lancet Infectious Diseases, 2023
- From information seeking to information avoidance: Understanding the health information behavior during a global health crisisInformation Processing & Management, 2021
- Nutzung von Gesundheitsinformationen im Internet: personenbezogene und motivationale EinflussfaktorenBundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 2020
- Consumer health information needs: A systematic review of measuresInformation Processing & Management, 2020
- A scoping review of consumer needs for cancer informationPatient Education and Counseling, 2019
- Cyberchondria: Overlap with health anxiety and unique relations with impairment, quality of life, and service utilizationPsychiatry Research, 2018