Visuospatial attention revamps cortical processing of sound: restrict stimulus uncertainty
Preprint
Abstract
Selective attentional biases arising from one sensory modality may manifest in another. The effects of visuospatial attention, often considered a foundation for visual object perception, are unclear in the auditory domain during audiovisual (AV) scene processing. This study investigates temporal and spatial factors that facilitate such cross-modal bias transfer at the neural level. Auditory encoding of random tone pips in AV scenes was investigated via a temporal response function model (TRF) of the participants’ electroencephalogram ( N =30). The spatially uninformative pips were associated with spatially distributed visual contrast reversals (‘flips’) through asynchronous, probabilistic AV temporal onset distributions. Participants deployed visuospatial selection on these AV stimuli to perform a task. A late (~300 ms) cross-modal transfer of the unimodal attentional bias was found on the neural representation of pips. Transfer depended on the selected visual input being ( i ) presented during or shortly after a related sound in a relatively limited temporal window (ii ) positioned across limited (1:4) visual foreground to background ratios. In addition, the magnitude of attentional enhancement was proportional to the proximity of flips to the foreground area. The results indicate that ongoing neural representations of sounds can incorporate relevant visuospatial attributes for auditory stream segregation.Keywords
This publication has 98 references indexed in Scilit:
- The spatial distribution of attention within and across objects.Journal of Experimental Psychology: Human Perception and Performance, 2012
- The multifaceted interplay between attention and multisensory integrationTrends in Cognitive Sciences, 2010
- Temporal dynamics of neuronal modulation during exogenous and endogenous shifts of visual attention in macaque area MTProceedings of the National Academy of Sciences, 2008
- Denoising based on spatial filteringJournal of Neuroscience Methods, 2008
- Object-based auditory and visual attentionTrends in Cognitive Sciences, 2008
- Sensor noise suppressionJournal of Neuroscience Methods, 2008
- Denoising based on time-shift PCAJournal of Neuroscience Methods, 2007
- PsychoPy—Psychophysics software in PythonJournal of Neuroscience Methods, 2007
- Visual cues can modulate integration and segregation of objects in auditory scene analysisBrain Research, 2007
- Hearing lips and seeing voicesNature, 1976