Virtual Big Heads in Extended Reality: Estimation of Ideal Head Scales and Perceptual Thresholds for Comfort and Facial Cues
Open Access
- 11 January 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Applied Perception
- Vol. 20 (1) , 1-31
Abstract
Extended reality (XR) technologies, such as virtual reality (VR) and augmented reality (AR), provide users, their avatars, and embodied agents a shared platform to collaborate in a spatial context. Although traditional face-to-face communication is limited by users’ proximity, meaning that another human’s non-verbal embodied cues become more difficult to perceive the farther one is away from that person, researchers and practitioners have started to look into ways to accentuate or amplify such embodied cues and signals to counteract the effects of distance with XR technologies. In this article, we describe and evaluate the Big Head technique, in which a human’s head in VR/AR is scaled up relative to their distance from the observer as a mechanism for enhancing the visibility of non-verbal facial cues, such as facial expressions or eye gaze. To better understand and explore this technique, we present two complimentary human-subject experiments in this article. In our first experiment, we conducted a VR study with a head-mounted display to understand the impact of increased or decreased head scales on participants’ ability to perceive facial expressions as well as their sense of comfort and feeling of “uncannniness” over distances of up to 10 m. We explored two different scaling methods and compared perceptual thresholds and user preferences. Our second experiment was performed in an outdoor AR environment with an optical see-through head-mounted display. Participants were asked to estimate facial expressions and eye gaze, and identify a virtual human over large distances of 30, 60, and 90 m. In both experiments, our results show significant differences in minimum, maximum, and ideal head scales for different distances and tasks related to perceiving faces, facial expressions, and eye gaze, and we also found that participants were more comfortable with slightly bigger heads at larger distances. We discuss our findings with respect to the technologies used, and we discuss implications and guidelines for practical applications that aim to leverage XR-enhanced facial cues.Keywords
Funding Information
- National Science Foundation (1564065)
- Collaborative Award (1800961, 1800947, 1800922)
- University of Central Florida, University of Florida, and Stanford University, respectively; the Office of Naval Research under Award (N00014-21-1-2578 and N00014-21-1-2882)
- AdventHealth Endowed Chair in Healthcare Simulation
This publication has 65 references indexed in Scilit:
- Wait, are you sad or angry? Large exposure time differences required for the categorization of facial expressions of emotionJournal of Vision, 2013
- The zone of comfort: Predicting visual discomfort with stereo displaysJournal of Vision, 2011
- The impact of facial emotional expressions on behavioral tendencies in women and men.Journal of Experimental Psychology: Human Perception and Performance, 2010
- Smile Through Your Fear and SadnessPsychological Science, 2009
- Virtual friend or threat? The effects of facial expression and gaze interaction on psychophysiological responses and emotional experiencePsychophysiology, 2009
- Personal space regulation by the human amygdalaNature Neuroscience, 2009
- Evaluation of real-world and computer-generated stylized facial expressionsACM Transactions on Applied Perception, 2007
- The Uncanny Valley: Effect of Realism on the Impression of Artificial Human FacesPRESENCE: Virtual and Augmented Reality, 2007
- Interpersonal Distance in Immersive Virtual EnvironmentsPersonality and Social Psychology Bulletin, 2003
- Facial expression and emotion.American Psychologist, 1993