Yuewei Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yuewei Zhang has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Kunal Gupta
Empathic Computing Laboratory, The University of Auckland, Grafton, Auckland, New Zealand
3 shared publications - Mark Billinghurst
ITMS, University of South Australia, Mawson Lakes, Australia
3 shared publications - Tamil Selvan Gunasekaran
Empathic Computing Lab, The University of Auckland, Auckland, New Zealand
3 shared publications - Conor Russomanno
OpenBCI, Inc, United States of America
2 shared publications - Nanditha Krishna
Amrita Vishwa Vidyapeetham, India
2 shared publications - Philip Pitts
OpenBCI, Inc, United States of America
2 shared publications
Latest Publications
- Open Access
- 23 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Finger Painting in VR: Multi-Dynamic Gestural Input for VR Painting
This study explores the multi-dynamic gestural interaction system using VR headsets and wearable devices, for enhancing VR painting with pressure control, gesture recognition, and haptic feedback. Testing demonstrated novel visual expressions through hand gestures, suggesting the potential for more nuanced and dynamic interactions in VR art and beyond.
- 23 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessFinger Painting in VR: Multi-Dynamic Gestural Input for VR Painting
This study explores the multi-dynamic gestural interaction system using VR headsets and wearable devices, for enhancing VR painting with pressure control, gesture recognition, and haptic feedback. Testing demonstrated novel visual expressions through hand gestures, suggesting the potential for more nuanced and dynamic interactions in VR art and beyond.
- 4 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (5) , 2671-2681
CAEVR: Biosignals-Driven Context-Aware Empathy in Virtual Reality
There is little research on how Virtual Reality (VR) applications can identify and respond meaningfully to users' emotional changes. In this paper, we investigate the impact of Context-Aware Empathic VR (CAEVR) on the emotional and cognitive aspects of user experience in VR. We developed a real-time emotion prediction model using electroencephalography (EEG), electrodermal activity (EDA), and heart rate variability (HRV) and used this in personalized and generalized models for emotion recognition. We then explored the application of this model in a context-aware empathic (CAE) virtual agent and an emotion-adaptive (EA) VR environment. We found a significant increase in positive emotions, cognitive load, and empathy toward the CAE agent, suggesting the potential of CAEVR environments to refine user-agent interactions. We identify lessons learned from this study and directions for future work.
- 4 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (5) , 2671-2681
CAEVR: Biosignals-Driven Context-Aware Empathy in Virtual Reality
There is little research on how Virtual Reality (VR) applications can identify and respond meaningfully to users' emotional changes. In this paper, we investigate the impact of Context-Aware Empathic VR (CAEVR) on the emotional and cognitive aspects of user experience in VR. We developed a real-time emotion prediction model using electroencephalography (EEG), electrodermal activity (EDA), and heart rate variability (HRV) and used this in personalized and generalized models for emotion recognition. We then explored the application of this model in a context-aware empathic (CAE) virtual agent and an emotion-adaptive (EA) VR environment. We found a significant increase in positive emotions, cognitive load, and empathy toward the CAE agent, suggesting the potential of CAEVR environments to refine user-agent interactions. We identify lessons learned from this study and directions for future work.
- Open Access
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-2
SensoryScape: Context-Aware Empathic VR Photography
SensoryScape presents a novel approach to context-aware empathic interactions (CAEIxs) using a VR head-mounted display (HMD) integrated with various biosensors. This innovative system addresses the need for personal, emotionally resonant, and empathic digital experiences by dynamically responding to users’ real-time emotional and situational context. SensoryScape harnesses the Galea VR HMD, a device with integrated physiological sensors that track bio-signals such as brain activity, skin responses, muscle movements, and heart rate variability. These real-time biosignals, along with situational context, help estimate the user’s emotional state within its context. The VR environment and empathic companion adapt to these cues, ensuring an optimized experience for the user’s current emotional state. The demonstration of SensoryScape highlights the potential of VR HMDs with integrated physiological sensors for crafting empathic digital experiences. Our research contributes to immersive, adaptive, and user-focused empathic interactions, marking a promising shift in human-computer interaction.
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessSensoryScape: Context-Aware Empathic VR Photography
SensoryScape presents a novel approach to context-aware empathic interactions (CAEIxs) using a VR head-mounted display (HMD) integrated with various biosensors. This innovative system addresses the need for personal, emotionally resonant, and empathic digital experiences by dynamically responding to users’ real-time emotional and situational context. SensoryScape harnesses the Galea VR HMD, a device with integrated physiological sensors that track bio-signals such as brain activity, skin responses, muscle movements, and heart rate variability. These real-time biosignals, along with situational context, help estimate the user’s emotional state within its context. The VR environment and empathic companion adapt to these cues, ensuring an optimized experience for the user’s current emotional state. The demonstration of SensoryScape highlights the potential of VR HMDs with integrated physiological sensors for crafting empathic digital experiences. Our research contributes to immersive, adaptive, and user-focused empathic interactions, marking a promising shift in human-computer interaction.
- Open Access
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Healing Horizons: Adaptive VR for Traumatic Brain Injury Rehabilitation
Healing Horizons presents a novel, bio-adaptive Virtual Reality (VR) approach to Traumatic Brain Injury (TBI) rehabilitation. Traditional therapies often fall short, prompting the need for a more personalised, dynamic intervention. Healing Horizons meets this demand by combining real-time physiological data with VR technology, facilitating effective recovery. The system uses the novel Galea VR head-mounted display (HMD) with integrated physiological sensors to continuously monitor brain activity, skin responses, muscle movements, and heart rate variability. These real-time bio-signals predict the user’s cognitive fatigue, a common challenge in TBI patients. The VR environment then adapts dynamically to these physiological cues, ensuring the therapeutic experience is optimised for the individual’s current cognitive state. This personalised approach helps develop resilience and social skills while addressing cognitive fatigue within a realistic yet controlled setting. Our demo showcases the potential of VR HMDs with physiological sensors to be used for bio-responsive virtual rehabilitation.
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessHealing Horizons: Adaptive VR for Traumatic Brain Injury Rehabilitation
Healing Horizons presents a novel, bio-adaptive Virtual Reality (VR) approach to Traumatic Brain Injury (TBI) rehabilitation. Traditional therapies often fall short, prompting the need for a more personalised, dynamic intervention. Healing Horizons meets this demand by combining real-time physiological data with VR technology, facilitating effective recovery. The system uses the novel Galea VR head-mounted display (HMD) with integrated physiological sensors to continuously monitor brain activity, skin responses, muscle movements, and heart rate variability. These real-time bio-signals predict the user’s cognitive fatigue, a common challenge in TBI patients. The VR environment then adapts dynamically to these physiological cues, ensuring the therapeutic experience is optimised for the individual’s current cognitive state. This personalised approach helps develop resilience and social skills while addressing cognitive fatigue within a realistic yet controlled setting. Our demo showcases the potential of VR HMDs with physiological sensors to be used for bio-responsive virtual rehabilitation.