A model of audio–visual motion integration during active self-movement
Open Access
- 3 February 2025
- journal article
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (2) , 8
Abstract
Despite good evidence for optimal audio–visual integration in stationary observers, few studies have considered the impact of self-movement on this process. When the head and/or eyes move, the integration of vision and hearing is complicated, as the sensory measurements begin in different coordinate frames. To successfully integrate these signals, they must first be transformed into the same coordinate frame. We propose that audio and visual motion cues are separately transformed using self-movement signals, before being integrated as body-centered cues to audio–visual motion. We tested this hypothesis using a psychophysical audio–visual integration task in which participants made left/right judgments of audio, visual, or audio–visual targets during self-generated yaw head rotations. Estimates of precision and bias from the audio and visual conditions were used to predict performance in the audio–visual conditions. We found that audio–visual performance was predicted well by models that suggested the transformation of cues into common coordinates but could not be explained by a model that did not rely on coordinate transformation before integration. We also found that precision specifically was better predicted by a model that accounted for shared noise arising from signals encoding head movement. Taken together, our findings suggest that motion perception in active observers is based on the integration of partially correlated body-centered signals.Keywords
This publication has 65 references indexed in Scilit:
- Influence of Head Position on the Spatial Representation of Acoustic TargetsJournal of Neurophysiology, 1999
- Neck-proprioceptive influence on auditory lateralizationExperimental Brain Research, 1999
- Perceived head-centric speed is affected by both extra-retinal and retinal errorsVision Research, 1998
- Inability of Rhesus Monkey Area V1 to Discriminate Between Self-induced and Externally Induced Retinal Image SlipEuropean Journal of Neuroscience, 1996
- Modification of the filehne illusion by conditioning visual stimuliVision Research, 1996
- Measurement and modeling of depth cue combination: in defense of weak fusionVision Research, 1995
- Coordinate transformations in the representation of spatial informationCurrent Opinion in Neurobiology, 1993
- Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputsJournal of Neurophysiology, 1988
- Retinal and Extraretinal Information in Movement Perception: How to Invert the Filehne IllusionPerception, 1987
- Position Constancy during Pursuit Eye Movement: An Investigation of the Filehne IllusionQuarterly Journal of Experimental Psychology, 1973