Using Large Language Models in Public Health Platforms: A Study of Platform Users’ and Editors’ Perspectives on Trust, Ethics and Risks
Open Access
- 6 April 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computing for Healthcare
Abstract
In the Netherlands, several public health platforms provide information and peer support to different patient groups such as people suffering from cancer or multiple sclerosis. With the rapid growth and development of Large Language Models (LLMs) in multiple sectors, these health platforms are considering the use of LLMs for personalized content generation and ease of information management. However, the sensitive nature of health information and personal experiences shared on such platforms introduces privacy and ethical risks, such as misinformation and bias. This study explores the concerns and risks associated with LLMs through interviews and focus groups with platform editors and users who use and access these platforms. Our findings show that risks related to content quality and quantity were most frequently identified. Moreover, the findings highlight the importance of disclosure if there is no human oversight, participants’ strong opposition to AI-generated blogs, and the potential of LLMs for personalization, provided users retain control over what they read. This work contributes to the ongoing discussion in human-centered computing about the ethical challenges and risks of adopting LLMs by presenting an empirical evaluation with editors and users. Moreover, the insights inform considerations and design guidelines for implementing LLMs on public health platforms.Keywords
This publication has 27 references indexed in Scilit:
- Critical Artificial Intelligence literacy: A scoping review and framework synthesisInternational Journal of Child-Computer Interaction, 2024
- Generative artificial intelligence and ethical considerations in health care: a scoping review and ethics checklistThe Lancet Digital Health, 2024
- Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language modelsArtificial Intelligence Review, 2024
- Do people trust humans more than ChatGPT?Journal of Behavioral and Experimental Economics, 2024
- Generative Artificial Intelligence to Transform Inpatient Discharge Summaries to Patient-Friendly Language and FormatJAMA Network Open, 2024
- Assessing the potential of GPT-4 to perpetuate racial and gender biases in health care: a model evaluation studyThe Lancet Digital Health, 2023
- Large language models propagate race-based medicinenpj Digital Medicine, 2023
- Auditing large language models: a three-layered approachAI and Ethics, 2023
- Ethics of large language models in medicine and medical researchThe Lancet Digital Health, 2023
- Changes in internet use and wishes of cancer survivors: A comparison between 2005 and 2017Cancer, 2019