Community perspectives on health AI: hopes, concerns and implications for health systems and trustworthy AI
Open Access
- 26 February 2026
- journal article
- research article
- Published by Springer Nature in AI and Ethics
- Vol. 6 (2) , 176
Abstract
The increasing use of artificial intelligence (AI) in healthcare has heightened public focus on issues of trust, transparency, and governance. In this study, we conducted five virtual community deliberations with Michigan residents (n = 159) to explore their hopes, concerns, and perspectives on how to promote trustworthiness in health AI. Participants were predominantly female (65%) with a mean age of 46 years, including 35% African American, 33% White, and 21% Middle Eastern/North African residents, with 40% reporting incomes below $50,000. Participants recognized AI’s potential to improve diagnostic accuracy, efficiency, and access to health information, but voiced concerns about privacy, lack of transparency, diminished human interaction, and insufficient oversight. They recommended clear communication about when and how AI tools are used; regulation and oversight that includes patient and community input; and the use of AI to augment, not replace, human judgment and empathy. These findings informed the development of practice and policy recommendations for trustworthy health AI frameworks emphasizing human-centeredness, transparency, oversight, and accountability, underscoring the critical role of public involvement in AI governance. Future research should engage diverse community perspectives when developing health AI tools to support safe, trustworthy implementation in healthcare.Keywords
Funding Information
- National Institute of Biomedical Imaging and Bioengineering (RO1-EB030492)
This publication has 28 references indexed in Scilit:
- Fifty Years of Trust Research in Health Care: A Synthetic ReviewThe Milbank Quarterly, 2023
- A conceptual framework for clinical and translational virtual community engagement researchJournal of Clinical and Translational Science, 2022
- Public Deliberation Process on Patient Perspectives on Health Information Sharing: Evaluative Descriptive StudyJMIR Cancer, 2022
- Patient and public involvement to build trust in artificial intelligence: A framework, tools, and case studiesPatterns, 2022
- Perspectives of Patients About Artificial Intelligence in Health CareJAMA Network Open, 2022
- Patient apprehensions about the use of artificial intelligence in healthcarenpj Digital Medicine, 2021
- Patient and general public attitudes towards clinical artificial intelligence: a mixed methods systematic reviewThe Lancet Digital Health, 2021
- Eliciting patient views on the allocation of limited healthcare resources: a deliberation on hepatitis C treatment in the Veterans Health AdministrationBMC Health Services Research, 2020
- Public Trust in Health Information Sharing: A Measure of System TrustHealth Services Research, 2017
- Effectiveness of public deliberation methods for gathering input on issues in healthcare: Results from a randomized trialSocial Science & Medicine, 2015