Ruoyu Wen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ruoyu Wen has a total of 54 co-authors. Here are the top co-authors by number of shared publications:
- Thammathip Piumsomboon
School of Product Design, University of Canterbury
10 shared publications - Simon Hoermann
University of Canterbury
8 shared publications - Mark Billinghurst
Auckland Bioengineering Institute, The University of Auckland
7 shared publications - Alaeddin Nassani
University of Aizu, Aizuwakamatsu, Fukushima, Japan
4 shared publications - Binyang Han
School of Product Design, University of Canterbury, Christchurch, New Zealand
4 shared publications - Jiashuo Cao
Auckland Bioengineering Institute, The University of Auckland
4 shared publications
Latest Publications
- Open Access
- 3 November 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 10 (7) , 1-51
FIERO: Empowering Creative Writing Through Collaborative Game Play
Creativity often flourishes in collaboration, such as when designers brainstorm a new app together, or storytellers collectively build a world with elements of each person’s narrative. However, collaborative storytelling can have challenges for participants, such as when they disagree about the plot proposed, or when different ideas become fragmented when voiced individually. While current tools for creative collaboration focus on synchronous online text sharing, they often neglect the social dynamics of in-person collaboration critical to creative synergy. To address this, we created FIERO, a multiplayer web-based card game. Physical cards provide tangible scaffolding and social interaction, while the digital interface generates contextual visuals, facilitate group decisions, ensure narrative coherence, and synthesize different idea contributions using Generative AI. Compared against online collaborative writing alone, the game significantly enhanced intuitive stimulation, idea fluency, and novelty generation, and improved the plot coherence of the stories created (N=60). The cards provided creative structure and social engagement, while the application interface provided contextualized augmentation without affecting player agency. This work shows how collaborative play can foster creative support.
- 3 November 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 10 (7) , 1-51
Open AccessFIERO: Empowering Creative Writing Through Collaborative Game Play
Creativity often flourishes in collaboration, such as when designers brainstorm a new app together, or storytellers collectively build a world with elements of each person’s narrative. However, collaborative storytelling can have challenges for participants, such as when they disagree about the plot proposed, or when different ideas become fragmented when voiced individually. While current tools for creative collaboration focus on synchronous online text sharing, they often neglect the social dynamics of in-person collaboration critical to creative synergy. To address this, we created FIERO, a multiplayer web-based card game. Physical cards provide tangible scaffolding and social interaction, while the digital interface generates contextual visuals, facilitate group decisions, ensure narrative coherence, and synthesize different idea contributions using Generative AI. Compared against online collaborative writing alone, the game significantly enhanced intuitive stimulation, idea fluency, and novelty generation, and improved the plot coherence of the stories created (N=60). The cards provided creative structure and social engagement, while the application interface provided contextualized augmentation without affecting player agency. This work shows how collaborative play can foster creative support.
- Open Access
- 2 September 2026
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- p. 1-36
I Made the Choice, Did I? Exploring the Influence of Goal-Directed AI on Human Decision-Making
1. Large language models (LLMs) have introduced significant changes to daily practices and are now widely applied in domains such as education (Kasneci et al., 2023), healthcare (Yang et al., 2023)...
- 2 September 2026
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- p. 1-36
Open AccessI Made the Choice, Did I? Exploring the Influence of Goal-Directed AI on Human Decision-Making
1. Large language models (LLMs) have introduced significant changes to daily practices and are now widely applied in domains such as education (Kasneci et al., 2023), healthcare (Yang et al., 2023)...
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Agents Look Cooperative, Not Credible: Nonverbal Cues and the Credibility Gap in Human-Agent Teams
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessAgents Look Cooperative, Not Credible: Nonverbal Cues and the Credibility Gap in Human-Agent Teams
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-18
AI of Oz: Enhancing Wizard of Oz Studies in HCI with AI Assistance for Human Moderation
The Wizard of Oz (WoZ) method is a common and popular approach for simulating interactive systems in Human-Computer Interaction (HCI). Running such studies is demanding for researchers because the human wizard must manage human–agent interactions in real time while keeping participants safe and the interaction natural. Many WoZ systems struggle to reproduce complex agent behaviours without minimal delays or heavy workload for the moderator. We introduce AI of Oz, a framework that uses large language models to support researchers by monitoring ongoing interactions, detecting sensitive moments, and suggesting contextually appropriate responses. In a study with 20 HCI-related researchers, the system improved participants’ ability to manage interactions and maintain control compared to a version without AI support. We outline implications for WoZ research and note current limitations and future directions.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Open AccessAI of Oz: Enhancing Wizard of Oz Studies in HCI with AI Assistance for Human Moderation
The Wizard of Oz (WoZ) method is a common and popular approach for simulating interactive systems in Human-Computer Interaction (HCI). Running such studies is demanding for researchers because the human wizard must manage human–agent interactions in real time while keeping participants safe and the interaction natural. Many WoZ systems struggle to reproduce complex agent behaviours without minimal delays or heavy workload for the moderator. We introduce AI of Oz, a framework that uses large language models to support researchers by monitoring ongoing interactions, detecting sensitive moments, and suggesting contextually appropriate responses. In a study with 20 HCI-related researchers, the system improved participants’ ability to manage interactions and maintain control compared to a version without AI support. We outline implications for WoZ research and note current limitations and future directions.
- 31 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (5) , 4451-4460
Exploring Mediation by an Embodied Virtual Agent in Immersive Triadic Collaborative Decision-Making
This study investigates Embodied Virtual Agents (EVAs) driven by Large Language Models (LLMs) as mediators in triadic collaboration where two users with conflicting goals must work towards a shared objective. We developed and evaluated an XR system where pairs (n = 24) collaborated on an office design task, assessing the impact of agent presence and embodiment. Our findings reveal that agent embodiment significantly enhanced co-presence, which in turn fostered interactions that led to better perceived collaboration and higher user preference, whereas frequent interactions with the disembodied agent was associated with lower user preference. Conversely, agent presence did not improve task efficiency or satisfaction. Notably, our qualitative analysis revealed that the LLM-driven agent spontaneously adopted emergent facilitative and evaluative mediation strategies that align with collaborating and compromising conflict-resolving modes, showcasing its potential as an adaptive collaborative aid without explicit programming. These results highlight that the value of EVAs in complex collaboration lies in their ability to shape social dynamics and provide nuanced, context-aware mediation, a different form of value than traditional productivity enhancement.
- 31 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (5) , 4451-4460
Exploring Mediation by an Embodied Virtual Agent in Immersive Triadic Collaborative Decision-Making
This study investigates Embodied Virtual Agents (EVAs) driven by Large Language Models (LLMs) as mediators in triadic collaboration where two users with conflicting goals must work towards a shared objective. We developed and evaluated an XR system where pairs (n = 24) collaborated on an office design task, assessing the impact of agent presence and embodiment. Our findings reveal that agent embodiment significantly enhanced co-presence, which in turn fostered interactions that led to better perceived collaboration and higher user preference, whereas frequent interactions with the disembodied agent was associated with lower user preference. Conversely, agent presence did not improve task efficiency or satisfaction. Notably, our qualitative analysis revealed that the LLM-driven agent spontaneously adopted emergent facilitative and evaluative mediation strategies that align with collaborating and compromising conflict-resolving modes, showcasing its potential as an adaptive collaborative aid without explicit programming. These results highlight that the value of EVAs in complex collaboration lies in their ability to shape social dynamics and provide nuanced, context-aware mediation, a different form of value than traditional productivity enhancement.
- Open Access
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 955-971
From Prompt to Presence: Co-Creating Personalised Emotional Sanctuaries in VR with Generative AI
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 955-971
Open AccessFrom Prompt to Presence: Co-Creating Personalised Emotional Sanctuaries in VR with Generative AI
- Top Cited PapersOpen Access
- 5 January 2026
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 13 (1) , e79954
Digital Humans for Depression Assessment and Intervention Support: Scoping Review
Background: The growing global burden of mental health disorders has intensified the search for scalable, accessible, and cost-effective interventions. Conversational agents in the form of digital humans have emerged as promising tools to deliver mental health support across diverse populations and settings. Objective: This scoping review aimed to analyze the role of digital humans in depression management, identifying their specific applications in both diagnostic processes and therapeutic interventions. Additionally, it aimed to evaluate the design choices implemented in digital human systems, including their appearance, interaction modalities, back-end intelligence systems, and the various roles they assume. Methods: Following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines, we systematically searched peer-reviewed literature across major databases, including ACM Digital Library, IEEE Xplore, Web of Science, and PubMed, to capture both psychological and technological perspectives. The search query included a wide variety of synonyms for digital humans and depression: (“avatar” OR “virtual agent” OR “embodied conversational agent” OR “relational agent” OR “digital human” OR “virtual human” OR “virtual character”) AND (“Major Depressive Disorder” OR “Depression”). Studies were included if they described the development, implementation, or evaluation of digital humans designed to support mental health outcomes. Data were charted on agent design, therapeutic approach, target population, delivery context, and reported effectiveness. Results: In total, 20 studies (2010‐2024) were included. Depression assessment studies comprised 35% (n=7), interventions 55% (n=11), and combined approaches 10% (n=2). Assessment protocols included the questionnaires Patient Health Questionnaire-9 and Very Short Visual Analog Scale of the Center for Epidemiologic Studies Depression Scale - Visual Analog Scale - Very Short version, semistructured interviews based on Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria, and interactive tasks designed to elicit emotional responses. Intervention approaches used cognitive behavioral therapy, psychoeducation, compassion-focused therapy, and avatar therapy. Digital humans assumed 5 distinct roles: interviewer (n=6), facilitator (n=3), counselor (n=3), educator (n=3), and actor (n=5). Interviewers primarily appeared in assessment studies, presenting structured questions. Counselors engaged in therapeutic dialogues, while educators delivered psychoeducational content. Facilitators assisted participants in achieving system goals. Actors portrayed specific emotions or dysfunctional beliefs to facilitate therapeutic processes. Studies highlighted digital humans’ utility in enhancing diagnostic processes and therapeutic interventions, noting the potential for transformation through physiological data integration. Conclusions: This study demonstrates that digital humans represent a transformative advancement in depression management, offering innovative applications across both assessment and intervention phases. The evidence reveals digital humans’ effectiveness in replicating traditional therapeutic roles while providing unique advantages, including 24/7 accessibility, reduced stigma, consistent care delivery, and personalized support. Digital humans can successfully function to establish therapeutic alliances and elicit meaningful engagement comparable with human providers. Findings underscore the need for continued research to fully realize digital humans’ potential in addressing depression-specific needs, advocating for expansion into diverse therapeutic scenarios, and exploration of unexplored digital human applications.
- 5 January 2026
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 13 (1) , e79954
Top Cited PapersOpen AccessDigital Humans for Depression Assessment and Intervention Support: Scoping Review
Background: The growing global burden of mental health disorders has intensified the search for scalable, accessible, and cost-effective interventions. Conversational agents in the form of digital humans have emerged as promising tools to deliver mental health support across diverse populations and settings. Objective: This scoping review aimed to analyze the role of digital humans in depression management, identifying their specific applications in both diagnostic processes and therapeutic interventions. Additionally, it aimed to evaluate the design choices implemented in digital human systems, including their appearance, interaction modalities, back-end intelligence systems, and the various roles they assume. Methods: Following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines, we systematically searched peer-reviewed literature across major databases, including ACM Digital Library, IEEE Xplore, Web of Science, and PubMed, to capture both psychological and technological perspectives. The search query included a wide variety of synonyms for digital humans and depression: (“avatar” OR “virtual agent” OR “embodied conversational agent” OR “relational agent” OR “digital human” OR “virtual human” OR “virtual character”) AND (“Major Depressive Disorder” OR “Depression”). Studies were included if they described the development, implementation, or evaluation of digital humans designed to support mental health outcomes. Data were charted on agent design, therapeutic approach, target population, delivery context, and reported effectiveness. Results: In total, 20 studies (2010‐2024) were included. Depression assessment studies comprised 35% (n=7), interventions 55% (n=11), and combined approaches 10% (n=2). Assessment protocols included the questionnaires Patient Health Questionnaire-9 and Very Short Visual Analog Scale of the Center for Epidemiologic Studies Depression Scale - Visual Analog Scale - Very Short version, semistructured interviews based on Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria, and interactive tasks designed to elicit emotional responses. Intervention approaches used cognitive behavioral therapy, psychoeducation, compassion-focused therapy, and avatar therapy. Digital humans assumed 5 distinct roles: interviewer (n=6), facilitator (n=3), counselor (n=3), educator (n=3), and actor (n=5). Interviewers primarily appeared in assessment studies, presenting structured questions. Counselors engaged in therapeutic dialogues, while educators delivered psychoeducational content. Facilitators assisted participants in achieving system goals. Actors portrayed specific emotions or dysfunctional beliefs to facilitate therapeutic processes. Studies highlighted digital humans’ utility in enhancing diagnostic processes and therapeutic interventions, noting the potential for transformation through physiological data integration. Conclusions: This study demonstrates that digital humans represent a transformative advancement in depression management, offering innovative applications across both assessment and intervention phases. The evidence reveals digital humans’ effectiveness in replicating traditional therapeutic roles while providing unique advantages, including 24/7 accessibility, reduced stigma, consistent care delivery, and personalized support. Digital humans can successfully function to establish therapeutic alliances and elicit meaningful engagement comparable with human providers. Findings underscore the need for continued research to fully realize digital humans’ potential in addressing depression-specific needs, advocating for expansion into diverse therapeutic scenarios, and exploration of unexplored digital human applications.
- Open Access
An Exploratory Study on AI-driven Visualisation Techniques on Decision Making in Extended Reality
The integration of extended reality (XR) with artificial intelligence (AI) introduces a new paradigm for user interaction, enabling AI to perceive user intent, stimulate the senses, and influence decision-making. We explored the impact of four AI-driven visualisation techniques -- `Inform,' `Nudge,' `Recommend,' and `Instruct' -- on user decision-making in XR using the Meta Quest Pro. To test these techniques, we used a pre-recorded 360-degree video of a supermarket, overlaying each technique through a virtual interface. We aimed to investigate how these different visualisation techniques with different levels of user autonomy impact preferences and decision-making. An exploratory study with semi-structured interviews provided feedback and design recommendations. Our findings emphasise the importance of maintaining user autonomy, enhancing AI transparency to build trust, and considering context in visualisation design.
Open AccessAn Exploratory Study on AI-driven Visualisation Techniques on Decision Making in Extended Reality
The integration of extended reality (XR) with artificial intelligence (AI) introduces a new paradigm for user interaction, enabling AI to perceive user intent, stimulate the senses, and influence decision-making. We explored the impact of four AI-driven visualisation techniques -- `Inform,' `Nudge,' `Recommend,' and `Instruct' -- on user decision-making in XR using the Meta Quest Pro. To test these techniques, we used a pre-recorded 360-degree video of a supermarket, overlaying each technique through a virtual interface. We aimed to investigate how these different visualisation techniques with different levels of user autonomy impact preferences and decision-making. An exploratory study with semi-structured interviews provided feedback and design recommendations. Our findings emphasise the importance of maintaining user autonomy, enhancing AI transparency to build trust, and considering context in visualisation design.
- Open Access
- 2 July 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Digital Humans for Depression Assessment and Intervention Support: A Scoping Review (Preprint)
BACKGROUND The growing global burden of mental health disorders has intensified the search for scalable, accessible, and cost-effective interventions. Conversational agents in the form of digital humans have emerged as promising tools to deliver mental health support across diverse populations and settings. OBJECTIVE The scoping review seeks to provide a comprehensive analysis of digital humans' roles in depression management, identifying their specific applications in both diagnostic processes and therapeutic interventions. Additionally, this study aims to evaluate the design choices implemented in digital human systems, including their appearance, interaction modalities, back-end intelligence systems, and the various roles they assume. METHODS Following the PRISMA-ScR guidelines, we systematically searched peer-reviewed literature across major databases including ACM Digital Library, IEEE Xplore, Web of Science, and PubMed to capture both psychological and technological perspectives. The search query used was to include a wide variety of synonyms for digital humans and depression: ("avatar" OR "virtual agent" OR "embodied conversational agent" OR "relational agent" OR "digital human" OR "virtual human" OR "virtual character") AND ("Major Depressive Disorder" OR "Depression"). Studies were included if they described the development, implementation, or evaluation of digital humans designed to support mental health outcomes. Data were charted on agent design, therapeutic approach, target population, delivery context, and reported effectiveness. RESULTS Twenty studies (2010-2024) were included. Depression assessment studies comprised 35% (n=7), interventions 55% (n=11), and combined approaches 10% (n=2). Assessment protocols included questionnaires (PHQ-9, CES-D-VAS-VS), semi-structured interviews based on DSM-5 criteria, and interactive tasks designed to elicit emotional responses. Intervention approaches employed Cognitive Behavioral Therapy, psychoeducation, Compassion-Focused Therapy, and Avatar Therapy. Digital humans assumed five distinct roles: interviewer (n=6), facilitator (n=3), counselor (n=3), educator (n=3), and actor (n=5). Interviewers primarily appeared in assessment studies, presenting structured questions. Counselors engaged in therapeutic dialogues, while educators delivered psychoeducational content. Facilitators assisted participants in achieving system goals. Actors portrayed specific emotions or dysfunctional beliefs to facilitate therapeutic processes. Studies highlighted digital humans' utility in enhancing diagnostic processes and therapeutic interventions, noting potential for transformation through physiological data integration. CONCLUSIONS This scoping review demonstrates that digital humans represent a transformative advancement in depression management, offering innovative applications across both assessment and intervention phases. The evidence reveals digital humans' effectiveness in replicating traditional therapeutic roles while providing unique advantages including 24/7 accessibility, reduced stigma, consistent care delivery, and personalized support. Digital humans successfully function across multiple roles with demonstrated capability to establish therapeutic alliances and elicit meaningful engagement comparable to human providers. Findings underscore the need for continued research to fully realize digital humans' potential in addressing depression-specific needs, advocating for expansion into diverse therapeutic scenarios and exploration of unexplored digital human applications.
- 2 July 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDigital Humans for Depression Assessment and Intervention Support: A Scoping Review (Preprint)
BACKGROUND The growing global burden of mental health disorders has intensified the search for scalable, accessible, and cost-effective interventions. Conversational agents in the form of digital humans have emerged as promising tools to deliver mental health support across diverse populations and settings. OBJECTIVE The scoping review seeks to provide a comprehensive analysis of digital humans' roles in depression management, identifying their specific applications in both diagnostic processes and therapeutic interventions. Additionally, this study aims to evaluate the design choices implemented in digital human systems, including their appearance, interaction modalities, back-end intelligence systems, and the various roles they assume. METHODS Following the PRISMA-ScR guidelines, we systematically searched peer-reviewed literature across major databases including ACM Digital Library, IEEE Xplore, Web of Science, and PubMed to capture both psychological and technological perspectives. The search query used was to include a wide variety of synonyms for digital humans and depression: ("avatar" OR "virtual agent" OR "embodied conversational agent" OR "relational agent" OR "digital human" OR "virtual human" OR "virtual character") AND ("Major Depressive Disorder" OR "Depression"). Studies were included if they described the development, implementation, or evaluation of digital humans designed to support mental health outcomes. Data were charted on agent design, therapeutic approach, target population, delivery context, and reported effectiveness. RESULTS Twenty studies (2010-2024) were included. Depression assessment studies comprised 35% (n=7), interventions 55% (n=11), and combined approaches 10% (n=2). Assessment protocols included questionnaires (PHQ-9, CES-D-VAS-VS), semi-structured interviews based on DSM-5 criteria, and interactive tasks designed to elicit emotional responses. Intervention approaches employed Cognitive Behavioral Therapy, psychoeducation, Compassion-Focused Therapy, and Avatar Therapy. Digital humans assumed five distinct roles: interviewer (n=6), facilitator (n=3), counselor (n=3), educator (n=3), and actor (n=5). Interviewers primarily appeared in assessment studies, presenting structured questions. Counselors engaged in therapeutic dialogues, while educators delivered psychoeducational content. Facilitators assisted participants in achieving system goals. Actors portrayed specific emotions or dysfunctional beliefs to facilitate therapeutic processes. Studies highlighted digital humans' utility in enhancing diagnostic processes and therapeutic interventions, noting potential for transformation through physiological data integration. CONCLUSIONS This scoping review demonstrates that digital humans represent a transformative advancement in depression management, offering innovative applications across both assessment and intervention phases. The evidence reveals digital humans' effectiveness in replicating traditional therapeutic roles while providing unique advantages including 24/7 accessibility, reduced stigma, consistent care delivery, and personalized support. Digital humans successfully function across multiple roles with demonstrated capability to establish therapeutic alliances and elicit meaningful engagement comparable to human providers. Findings underscore the need for continued research to fully realize digital humans' potential in addressing depression-specific needs, advocating for expansion into diverse therapeutic scenarios and exploration of unexplored digital human applications.
- Top Cited PapersOpen Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-29
Can AI Prompt Humans? Multimodal Agents Prompt Players? Game Actions and Show Consequences to Raise Sustainability Awareness
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-29
Top Cited PapersOpen AccessCan AI Prompt Humans? Multimodal Agents Prompt Players? Game Actions and Show Consequences to Raise Sustainability Awareness