Exploring the impact of non‐verbal cues on user experience in immersive virtual reality
Open Access
- 19 December 2023
- journal article
- research article
- Published by Wiley in Computer Animation and Virtual Worlds
- Vol. 35 (1)
Abstract
Face‐to‐face communication relies extensively on non‐verbal cues (NVCs) which complement, or at times dominate, the communicative process as they convey emotions with intense salience, thus definitively affecting interpersonal communication. The capture, transference, and subsequent interpretation of NVCs becomes complicated in computer‐mediated communicative processes, particularly in shared virtual worlds, for which there is growing interest both in regard to NVCs technological integration and their affective impact. This paper presents a between‐groups experimental setup which is facilitated in immersive virtual reality (IVR), and examines NVCs effects on user experience, with special emphasis on degree of attention toward each NVC as an isolated controlled variable of a scripted performance by a virtual character (VC). This study aims to evaluate NVCs fidelity based on the capabilities of the motion‐capture technologies utilized to address cue integration developmental challenges and examines NVCs impact on users' perceived realism of the VC, their empathy toward him, and the degree of social presence experienced. To meet the objectives set the affective impact of low‐fidelity automated NVCs and high‐fidelity real‐time captured NVCs were compared. The findings of the evaluation suggest that although NVCs do impact user experience to an extent, their effects are notably more subtle compared to previous studies.Keywords
Funding Information
- Hellenic Foundation for Research and Innovation (HFRI‐FM17‐1168)
This publication has 29 references indexed in Scilit:
- Factors Affecting Enjoyment of Virtual Reality Games: A Comparison Involving Consumer-Grade Virtual Reality TechnologyGames for Health Journal, 2019
- The Reality of Virtual Reality: A Comparison of Pedestrian Behavior in Real and Virtual EnvironmentsProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2018
- On the Effect of Social Context in Virtual Reality: An Examination of the Determinants of Human Behavior in Shared Immersive Virtual EnvironmentsIEEE Consumer Electronics Magazine, 2018
- AVATAREX2018
- Immersive Environments and Virtual Reality: Systematic Review and Advances in Communication, Interaction and SimulationMultimodal Technologies and Interaction, 2017
- Introducing and Evaluating the Behavior of Non-verbal Features in the Virtual LearningInternational Education Studies, 2015
- Using eye gaze, head pose, and facial expression for personalized non-player character interaction2011
- Nonverbal Influence2002
- The effect of power on susceptibility to emotional contagionCognition and Emotion, 1990
- Constants across cultures in the face and emotion.Journal of Personality and Social Psychology, 1971