Multiple time scales of the ventriloquism aftereffect
Open Access
- 1 August 2018
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 13 (8) , e0200930
Abstract
The ventriloquism aftereffect (VAE) refers to a shift in auditory spatial perception following exposure to a spatial disparity between auditory and visual stimuli. The VAE has been previously measured on two distinct time scales. Hundreds or thousands of exposures to a an audio-visual spatial disparity produces enduring VAE that persists after exposure ceases. Exposure to a single audio-visual spatial disparity produces immediate VAE that decays over seconds. To determine if these phenomena are two extremes of a continuum or represent distinct processes, we conducted an experiment with normal hearing listeners that measured VAE in response to a repeated, constant audio-visual disparity sequence, both immediately after exposure to each audio-visual disparity and after the end of the sequence. In each experimental session, subjects were exposed to sequences of auditory and visual targets that were constantly offset by +8° or −8° in azimuth from one another, then localized auditory targets presented in isolation following each sequence. Eye position was controlled throughout the experiment, to avoid the effects of gaze on auditory localization. In contrast to other studies that did not control eye position, we found both a large shift in auditory perception that decayed rapidly after each AV disparity exposure, along with a gradual shift in auditory perception that grew over time and persisted after exposure to the AV disparity ceased. We modeled the temporal and spatial properties of the measured auditory shifts using grey box nonlinear system identification, and found that two models could explain the data equally well. In the power model, the temporal decay of the ventriloquism aftereffect was modeled with a power law relationship. This causes an initial rapid drop in auditory shift, followed by a long tail which accumulates with repeated exposure to audio-visual disparity. In the double exponential model, two separate processes were required to explain the data, one which accumulated and decayed exponentially and the other which slowly integrated over time. Both models fit the data best when the spatial spread of the ventriloquism aftereffect was limited to a window around the location of the audio-visual disparity. We directly compare the predictions made by each model, and suggest additional measurements that could help distinguish which model best describes the mechanisms underlying the VAE.Keywords
Funding Information
- National Institute on Deafness and Other Communication Disorders (P30DC05409)
- National Institute on Deafness and Other Communication Disorders (T32DC00997404)
- National Eye Institute (P30EY01319)
- National Eye Institute (T32EY00712525)
- Arthur J. Schmitt Foundation
This publication has 32 references indexed in Scilit:
- Influence of aging on human sound localizationJournal of Neurophysiology, 2011
- Recalibration of Auditory Space following Milliseconds of Cross-Modal DiscrepancyJournal of Neuroscience, 2011
- Computational Characterization of Visually Induced Auditory Spatial AdaptationFrontiers in Integrative Neuroscience, 2011
- Probability Matching as a Computational Strategy Used in PerceptionPLOS Computational Biology, 2010
- Perception of Auditory, Visual, and Egocentric Spatial Alignment Adapts Differently to Changes in Eye PositionJournal of Neurophysiology, 2010
- Reference Frame of the Ventriloquism AftereffectJournal of Neuroscience, 2009
- The aftereffects of ventriloquism: Patterns of spatial generalizationPerception & Psychophysics, 2006
- Plasticity in human sound localization induced by compressed spatial visionNature Neuroscience, 2003
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- The Locus of Adaptation to Auditory—Visual ConflictPerception, 1973