On the Relative Importance of Visual and Spatial Audio Rendering on VR Immersion
Authors:
Top Cited Papers
Open Access
- 30 September 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Signal Processing
- Vol. 2
Abstract
A study was performed using a virtual environment to investigate the relative importance of spatial audio fidelity and video resolution on perceived audio-visual quality and immersion. Subjects wore a head-mounted display and headphones and were presented with a virtual environment featuring music and speech stimuli using three levels each of spatial audio quality and video resolution. Spatial audio was rendered monaurally, binaurally with head-tracking, and binaurally with head-tracking and room acoustic rendering. Video was rendered at resolutions of 0.5 megapixels per eye, 1.5 megapixels per eye, and 2.5 megapixels per eye. Results showed that both video resolution and spatial audio rendering had a statistically significant effect on both immersion and audio-visual quality. Most strikingly, the results showed that under the conditions that were tested in the experiment, the addition of room acoustic rendering to head-tracked binaural audio had the same improvement on immersion as increasing the video resolution five-fold, from 0.5 megapixels per eye to 2.5 megapixels per eye.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/V002554/1)
This publication has 19 references indexed in Scilit:
- 3D Beam Tracing Based on Visibility Lookup for Interactive Acoustic Modeling2016
- Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory lossAttention, Perception, & Psychophysics, 2015
- Efficient Synthesis of Room Acoustics via Scattering Delay NetworksIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Virtual Audio SystemsPRESENCE: Virtual and Augmented Reality, 2008
- Perceptual simplification for model-based binaural room auralisationApplied Acoustics, 2007
- Presence and Image Quality: The Case of High-Definition TelevisionMedia Psychology, 2005
- Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments2003
- Measuring Presence in Virtual Environments: A Presence QuestionnairePRESENCE: Virtual and Augmented Reality, 1998
- Presence within Virtual Environments as a Function of Visual Display ParametersPRESENCE: Virtual and Augmented Reality, 1996
- The Sense of Presence within Auditory Virtual EnvironmentsPRESENCE: Virtual and Augmented Reality, 1996