Comparing AI Roles and Support Types in Digital Health: A Randomized Factorial Experiment with Patients and Providers (Preprint)
Preprint
- 21 September 2026
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND The increasing demand for digital health services has highlighted the need for innovative solutions to enhance accessibility and quality of care. AI has emerged as a promising tool, offering capabilities such as personalized treatment plans and virtual consultations. Despite these advancements, the acceptance of AI in digital health remains a critical concern, with potential ethical and practical challenges. OBJECTIVE The objective of this study is to evaluate how different AI roles and support types influence the perceptions of AI tools among both patients and healthcare providers. METHODS We recruited healthcare providers (N=251) and the general public (N=396) to examine their perceptions of AI healthcare chatbots. Participants were randomly assigned to interact with one of six LLM-based chatbots designed within a 2×3 factorial framework: AI roles (assisting patients vs. assisting providers) and support type (task, companion, or control). Following the interaction, participants reported perceived warmth and competence, emotional and informational support, and technology acceptance using validated scales. Chat histories were also recorded, from which we extracted linguistic features and conversation topics. We ran a factorial analysis of covariance (ANCOVA) on each perception construct and each linguistic feature, testing the main effects of role and support type and their interaction. We also fitted separate linear regression models for providers and patients to examine how perceptions varied with participants’ demographic characteristics and prior beliefs about AI. RESULTS We found that providers were generally more conservative than patients, reporting lower scores on five of the seven constructs. Independent of role, the task chatbot was rated highest on competence, informational support, attitudes, and intention to adopt, while the companion chatbot was rated warmer than the task chatbot but no higher than the general-purpose chatbot on warmth or emotional support. Participants’ conversations followed the same pattern, with those talking to the task chatbot asking more questions and those talking to the companion chatbot focusing more on their feelings. Across both groups, participants’ general trust in AI predicted their perceptions of every construct, and among patients, those who had a regular doctor, were female, had less education, or knew more about AI also gave higher ratings. CONCLUSIONS This study contributes to understanding both providers’ and patients’ perceptions of using chatbots in different roles and support types, ultimately suggesting that future healthcare AI systems should build on domain-specific expertise and users’ prior trust in AI, while finding better ways to convey warmth that users actually perceive.Keywords
This publication has 39 references indexed in Scilit:
- Linguistic comparison of AI- and human-written responses to online mental health queriesnpj Artificial Intelligence, 2026
- Author Correction: Patient perceptions of empathy in physician and artificial intelligence chatbot responses to patient questions about cancernpj Digital Medicine, 2025
- Patients’ Trust in Health Systems to Use Artificial IntelligenceJAMA Network Open, 2025
- Comparing perceived empathy and intervention strategies of an AI chatbot and human psychotherapists in online mental health supportCounselling and Psychotherapy Research, 2024
- GPT-4o, DALL-E, and Whisper2024
- Innovation and challenges of artificial intelligence technology in personalized healthcareScientific Reports, 2024
- Artificial empathy in healthcare chatbots: Does it feel authentic?Computers in Human Behavior: Artificial Humans, 2024
- Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-beingnpj Digital Medicine, 2023
- Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media ForumJAMA Internal Medicine, 2023
- Warmth and Competence as Universal Dimensions of Social Perception: The Stereotype Content Model and the BIAS Map2008