Generic HRTFs May be Good Enough in Virtual Reality. Improving Source Localization through Cross-Modal Plasticity
Open Access
- 2 February 2018
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 12, 21
Abstract
Auditory spatial localization in humans is performed using a combination of interaural time differences, interaural level differences, as well as spectral cues provided by the geometry of the ear. To render spatialized sounds within a virtual reality (VR) headset, either individualized or generic Head Related Transfer Functions (HRTFs) are usually employed. The former require arduous calibrations, but enable accurate auditory source localization, which may lead to a heightened sense of presence within VR. The latter obviate the need for individualized calibrations, but result in less accurate auditory source localization. Previous research on auditory source localization in the real world suggests that our representation of acoustic space is highly plastic. In light of these findings, we investigated whether auditory source localization could be improved for users of generic HRTFs via cross-modal learning. The results show that pairing a dynamic auditory stimulus, with a spatio-temporally aligned visual counterpart, enabled users of generic HRTFs to improve subsequent auditory source localization. Exposure to the auditory stimulus alone or to asynchronous audiovisual stimuli did not improve auditory source localization. These findings have important implications for human perception as well as the development of VR systems as they indicate that generic HRTFs may be enough to enable good auditory source localization in VR.Keywords
This publication has 53 references indexed in Scilit:
- Evidence for Training-Induced Plasticity in Multisensory Brain Structures: An MEG StudyPLOS ONE, 2012
- Recalibration of Auditory Space following Milliseconds of Cross-Modal DiscrepancyJournal of Neuroscience, 2011
- The cocktail party problemCurrent Biology, 2009
- Visual influences on auditory spatial learningPhilosophical Transactions of the Royal Society B: Biological Sciences, 2008
- Perceptual Organization of Sound Begins in the Auditory PeripheryCurrent Biology, 2008
- Multisensory integration: current issues from the perspective of the single neuronNature Reviews Neuroscience, 2008
- Sound Representing Self-Motion in Virtual Environments Enhances Linear VectionPRESENCE: Virtual and Augmented Reality, 2008
- Is neocortex essentially multisensory?Trends in Cognitive Sciences, 2006
- HRTF measurements of a KEMARThe Journal of the Acoustical Society of America, 1995
- Some Further Experiments upon the Recognition of Speech, with One and with Two EarsThe Journal of the Acoustical Society of America, 1954