Zinan Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Zinan Zhang has a total of 29 co-authors. Here are the top co-authors by number of shared publications:
- Akram Bayat
Northeastern University, Khoury College of Computer Sciences, San Jose, USA
3 shared publications - Shreevidhya Shambanna
Northeastern University
3 shared publications - Yuqi Hu
Herbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego
2 shared publications - Anushka Anand1 shared publication
Brandon Watanabe
1 shared publication- Brandon Watanabe
San Francisco State University
1 shared publication
Latest Publications
- Open Access
- 14 July 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Emotionally Responsive AI Virtual Patients for Simulation Training in Speech-Language Pathology: A Pilot Mixed Methods Evaluation (Preprint)
BACKGROUND Speech-language pathology (SLP) students need repeated opportunities to practice clinical communication with patients who have communication disorders, including aphasia. Existing simulations support case-based learning, but many provide limited open-ended dialogue and limited affective feedback during communication breakdowns. OBJECTIVE This study aimed to describe and pilot-evaluate Virtual Observation and Interactive Clinical Education (V.O.I.C.E.), an emotionally responsive artificial intelligence (AI) virtual patient system for aphasia-focused communication training in graduate SLP education. METHODS We conducted a single-group, mixed methods pilot study with 11 graduate SLP students. V.O.I.C.E. combines a large language model patient persona with poststroke Broca aphasia, a multimodal affect pipeline that renders patient emotion through speech prosody, facial expression, and gesture, and an automated rubric-guided debriefing report. Participants completed three approximately 10-minute simulations with progressively more severe aphasia presentations. Quantitative measures included pre-post self-efficacy for clinical communication and poststudy ratings of dialogue realism, voice realism, facial/gesture realism, usability, and educational value, which were analyzed descriptively. Qualitative measures including open-ended questions examining participants’ experience with and attitudes towards the AI patient, which were analyzed using hybrid deductive-inductive content analysis. RESULTS Overall self-efficacy improved significantly after the simulations, with a mean within-person gain of 1.09 points on a 6-point scale (95% CI 0.33-1.84; p=.03). Significant gains were observed for confidence in interviewing clients with aphasia (mean 2.33 to 3.89; change +1.56; p=.04) and responding to unexpected patient behavior (mean 3.73 to 5.09; change +1.36; p=.03). Confidence gains were positively associated with perceived dialogue realism (Spearman rho=0.79; p=.01), facial/gesture realism (rho=0.81; p=.01), and voice realism (rho=0.75; p=.02). Qualitatively, students described V.O.I.C.E. as a safe first step toward clinical practice that supported iterative practice, feedback-driven strategy refinement, metacognitive awareness, and rehearsal of emotionally challenging interactions; they also identified limitations related to speech recognition, emotional subtlety, feedback specificity, and the need for direct patient contact. CONCLUSIONS This pilot study suggests that emotionally responsive AI virtual patients may provide a useful opportunity for SLP students in their early stages of learning and practicing aphasia-focused clinical communication. The findings highlight the importance of multimodal realism, emotionally contingent patient behavior, and actionable debriefing. Larger controlled studies are needed to further evaluate the efficacy of the V.O.I.C.E. system.
- 14 July 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEmotionally Responsive AI Virtual Patients for Simulation Training in Speech-Language Pathology: A Pilot Mixed Methods Evaluation (Preprint)
BACKGROUND Speech-language pathology (SLP) students need repeated opportunities to practice clinical communication with patients who have communication disorders, including aphasia. Existing simulations support case-based learning, but many provide limited open-ended dialogue and limited affective feedback during communication breakdowns. OBJECTIVE This study aimed to describe and pilot-evaluate Virtual Observation and Interactive Clinical Education (V.O.I.C.E.), an emotionally responsive artificial intelligence (AI) virtual patient system for aphasia-focused communication training in graduate SLP education. METHODS We conducted a single-group, mixed methods pilot study with 11 graduate SLP students. V.O.I.C.E. combines a large language model patient persona with poststroke Broca aphasia, a multimodal affect pipeline that renders patient emotion through speech prosody, facial expression, and gesture, and an automated rubric-guided debriefing report. Participants completed three approximately 10-minute simulations with progressively more severe aphasia presentations. Quantitative measures included pre-post self-efficacy for clinical communication and poststudy ratings of dialogue realism, voice realism, facial/gesture realism, usability, and educational value, which were analyzed descriptively. Qualitative measures including open-ended questions examining participants’ experience with and attitudes towards the AI patient, which were analyzed using hybrid deductive-inductive content analysis. RESULTS Overall self-efficacy improved significantly after the simulations, with a mean within-person gain of 1.09 points on a 6-point scale (95% CI 0.33-1.84; p=.03). Significant gains were observed for confidence in interviewing clients with aphasia (mean 2.33 to 3.89; change +1.56; p=.04) and responding to unexpected patient behavior (mean 3.73 to 5.09; change +1.36; p=.03). Confidence gains were positively associated with perceived dialogue realism (Spearman rho=0.79; p=.01), facial/gesture realism (rho=0.81; p=.01), and voice realism (rho=0.75; p=.02). Qualitatively, students described V.O.I.C.E. as a safe first step toward clinical practice that supported iterative practice, feedback-driven strategy refinement, metacognitive awareness, and rehearsal of emotionally challenging interactions; they also identified limitations related to speech recognition, emotional subtlety, feedback specificity, and the need for direct patient contact. CONCLUSIONS This pilot study suggests that emotionally responsive AI virtual patients may provide a useful opportunity for SLP students in their early stages of learning and practicing aphasia-focused clinical communication. The findings highlight the importance of multimodal realism, emotionally contingent patient behavior, and actionable debriefing. Larger controlled studies are needed to further evaluate the efficacy of the V.O.I.C.E. system.
- 25 June 2026
- Published by Springer Nature
- p. 354-368
SimPath: Clinically Grounded AI Patients for Therapist Training
- 25 June 2026
- Published by Springer Nature
- p. 354-368
SimPath: Clinically Grounded AI Patients for Therapist Training
- Open Access
- 4 February 2026
- Published by Springer Nature in Research Square
"A Safe First Step": Design and Evaluation of an Emotionally Expressive AI Virtual Patient for Clinical Simulation in Speech-Language Pathology Training
Speech-language pathology (SLP) training programs face persistent challenges in providing sufficient opportunities for clinical placements or simulations that allow students to practice clinical communication with patients with communication disorders. We designed and implemented V.O.I.C.E., an AI-powered virtual patient system that enables realistic, open-ended clinical simulation for SLP students. V.O.I.C.E. integrates (1) a large language model (LLM) role-play agent designed to produce responses consistent with symptoms of post-stroke expressive aphasia (Broca’s aphasia), (2) a multimodal emotional expression pipeline that renders context-appropriate emotions of the virtual patient through coordinated speech prosody, facial expressions, and gestures, and (3) an LLM-based, rubric-guided debriefing module that generates structured formative feedback across core clinical communication competencies. We conducted a pilot mixed-methods, quasi-experimental evaluation with 11 graduate-level SLP students, where they completed three simulation sessions using the V.O.I.C.E system with progressive challenges. Results show significant gains in students' overall self-efficacy for interacting with Broca's aphasia patients in clinical settings. The self-efficacy gains were moderated by students’ perceptions of multimodal realism of the simulations. Qualitative findings highlight the system’s value as a low-stakes “bridge” for transition to clinical practice, which supports learning through iterative practice, reflection, and strategy refinement. This work provides a framework for AI-based simulation training applications that emphasizes interpersonal communication.
- 4 February 2026
- Published by Springer Nature in Research Square
Open Access"A Safe First Step": Design and Evaluation of an Emotionally Expressive AI Virtual Patient for Clinical Simulation in Speech-Language Pathology Training
Speech-language pathology (SLP) training programs face persistent challenges in providing sufficient opportunities for clinical placements or simulations that allow students to practice clinical communication with patients with communication disorders. We designed and implemented V.O.I.C.E., an AI-powered virtual patient system that enables realistic, open-ended clinical simulation for SLP students. V.O.I.C.E. integrates (1) a large language model (LLM) role-play agent designed to produce responses consistent with symptoms of post-stroke expressive aphasia (Broca’s aphasia), (2) a multimodal emotional expression pipeline that renders context-appropriate emotions of the virtual patient through coordinated speech prosody, facial expressions, and gestures, and (3) an LLM-based, rubric-guided debriefing module that generates structured formative feedback across core clinical communication competencies. We conducted a pilot mixed-methods, quasi-experimental evaluation with 11 graduate-level SLP students, where they completed three simulation sessions using the V.O.I.C.E system with progressive challenges. Results show significant gains in students' overall self-efficacy for interacting with Broca's aphasia patients in clinical settings. The self-efficacy gains were moderated by students’ perceptions of multimodal realism of the simulations. Qualitative findings highlight the system’s value as a low-stakes “bridge” for transition to clinical practice, which supports learning through iterative practice, reflection, and strategy refinement. This work provides a framework for AI-based simulation training applications that emphasizes interpersonal communication.