Audiovisual integration in depth: multisensory binding and gain as a function of distance
Open Access
- 26 April 2018
- journal article
- research article
- Published by Springer Nature in Experimental Brain Research
- Vol. 236 (7) , 1939-1951
Abstract
The integration of information across sensory modalities is dependent on the spatiotemporal characteristics of the stimuli that are paired. Despite large variation in the distance over which events occur in our environment, relatively little is known regarding how stimulus-observer distance affects multisensory integration. Prior work has suggested that exteroceptive stimuli are integrated over larger temporal intervals in near relative to far space, and that larger multisensory facilitations are evident in far relative to near space. Here, we sought to examine the interrelationship between these previously established distance-related features of multisensory processing. Participants performed an audiovisual simultaneity judgment and redundant target task in near and far space, while audiovisual stimuli were presented at a range of temporal delays (i.e., stimulus onset asynchronies). In line with the previous findings, temporal acuity was poorer in near relative to far space. Furthermore, reaction time to asynchronously presented audiovisual targets suggested a temporal window for fast detection—a range of stimuli asynchronies that was also larger in near as compared to far space. However, the range of reaction times over which multisensory response enhancement was observed was limited to a restricted range of relatively small (i.e., 150 ms) asynchronies, and did not differ significantly between near and far space. Furthermore, for synchronous presentations, these distance-related (i.e., near vs. far) modulations in temporal acuity and multisensory gain correlated negatively at an individual subject level. Thus, the findings support the conclusion that multisensory temporal binding and gain are asymmetrically modulated as a function of distance from the observer, and specifies that this relationship is specific for temporally synchronous audiovisual stimulus presentations.Keywords
Funding Information
- National Science Foundation
- Foundation for the National Institutes of Health (HD083211)
- National Institutes of Health (MH109225)
This publication has 68 references indexed in Scilit:
- Recalibration of the Multisensory Temporal Window of Integration Results from Changing Task DemandsPLOS ONE, 2013
- Motor-Sensory Recalibration Modulates Perceived Simultaneity of Cross-Modal Events at Different DistancesFrontiers in Psychology, 2013
- Interactions between the spatial and temporal stimulus factors that influence multisensory integration in human performanceExperimental Brain Research, 2012
- Spatiotemporal architecture of cortical receptive fields and its impact on multisensory interactionsExperimental Brain Research, 2009
- Superadditivity in multisensory integration: putting the computation in contextNeuroReport, 2007
- Simultaneity ConstancyPerception, 2004
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002
- Spatial relevance determines facilitatory and inhibitory effects of auditory covert spatial orienting.Journal of Experimental Psychology: Human Perception and Performance, 1999
- The neuropsychology of 3-D space.Psychological Bulletin, 1998
- Visual-Auditory Distance ConstancyNature, 1971