Joint Encoding of Auditory Timing and Location in Visual Cortex
- 1 July 2019
- journal article
- research article
- Published by MIT Press in Journal of Cognitive Neuroscience
- Vol. 31 (7) , 1002-1017
Abstract
Co-occurring sounds can facilitate perception of spatially and temporally correspondent visual events. Separate lines of research have identified two putatively distinct neural mechanisms underlying two types of crossmodal facilitations: Whereas crossmodal phase resetting is thought to underlie enhancements based on temporal correspondences, lateralized occipital evoked potentials (ERPs) are thought to reflect enhancements based on spatial correspondences. Here, we sought to clarify the relationship between these two effects to assess whether they reflect two distinct mechanisms or, rather, two facets of the same underlying process. To identify the neural generators of each effect, we examined crossmodal responses to lateralized sounds in visually responsive cortex of 22 patients using electrocorticographic recordings. Auditory-driven phase reset and ERP responses in visual cortex displayed similar topography, revealing significant activity in pericalcarine, inferior occipital–temporal, and posterior parietal cortex, with maximal activity in lateral occipitotemporal cortex (potentially V5/hMT+). Laterality effects showed similar but less widespread topography. To test whether lateralized and nonlateralized components of crossmodal ERPs emerged from common or distinct neural generators, we compared responses throughout visual cortex. Visual electrodes responded to both contralateral and ipsilateral sounds with a contralateral bias, suggesting that previously observed laterality effects do not emerge from a distinct neural generator but rather reflect laterality-biased responses in the same neural populations that produce phase-resetting responses. These results suggest that crossmodal phase reset and ERP responses previously found to reflect spatial and temporal facilitation in visual cortex may reflect the same underlying mechanism. We propose a new unified model to account for these and previous results.Keywords
This publication has 52 references indexed in Scilit:
- Salient Sounds Activate Human Visual Cortex AutomaticallyJournal of Neuroscience, 2013
- Sounds Reset Rhythms of Visual Cortex and Corresponding Human Visual PerceptionCurrent Biology, 2012
- Oscillatory Alpha-Band Mechanisms and the Deployment of Spatial Attention to Anticipated Auditory and Visual Target Locations: Supramodal or Sensory-Specific Control Mechanisms?The Journal of Neuroscience, 2011
- Ready, Set, Reset: Stimulus-Locked Periodicity in Behavioral Performance Demonstrates the Consequences of Cross-Sensory Phase ResetThe Journal of Neuroscience, 2011
- Sound-Induced Enhancement of Low-Intensity Vision: Multisensory Influences on Human Sensory-Specific Cortices and Thalamic Bodies Relate to Perceptual Enhancement of Visual Detection SensitivityJournal of Neuroscience, 2010
- The Leading Sense: Supramodal Control of Neurophysiological Context by AttentionNeuron, 2009
- Intra- and cross-modal cuing of spatial attention: Time courses and mechanismsVision Research, 2009
- Is neocortex essentially multisensory?Trends in Cognitive Sciences, 2006
- Cortical Surface-Based AnalysisNeuroImage, 1999
- Cortical Surface-Based AnalysisNeuroImage, 1999