Contextual modulation of primary visual cortex by auditory signals
Open Access
- 19 February 2017
- journal article
- review article
- Published by The Royal Society in Philosophical Transactions of the Royal Society B: Biological Sciences
- Vol. 372 (1714) , 20160104
Abstract
Early visual cortex receives non-feedforward input from lateral and top-down connections (Muckli & Petro 2013 Curr. Opin. Neurobiol. 23 , 195–201. ( doi:10.1016/j.conb.2013.01.020 )), including long-range projections from auditory areas. Early visual cortex can code for high-level auditory information, with neural patterns representing natural sound stimulation (Vetter et al. 2014 Curr. Biol. 24 , 1256–1262. ( doi:10.1016/j.cub.2014.04.020 )). We discuss a number of questions arising from these findings. What is the adaptive function of bimodal representations in visual cortex? What type of information projects from auditory to visual cortex? What are the anatomical constraints of auditory information in V1, for example, periphery versus fovea, superficial versus deep cortical layers? Is there a putative neural mechanism we can infer from human neuroimaging data and recent theoretical accounts of cortex? We also present data showing we can read out high-level auditory information from the activation patterns of early visual cortex even when visual cortex receives simple visual stimulation, suggesting independent channels for visual and auditory signals in V1. We speculate which cellular mechanisms allow V1 to be contextually modulated by auditory input to facilitate perception, cognition and behaviour. Beyond cortical feedback that facilitates perception, we argue that there is also feedback serving counterfactual processing during imagery, dreaming and mind wandering, which is not relevant for immediate perception but for behaviour and cognition over a longer time frame. This article is part of the themed issue ‘Auditory and visual scene analysis’.Keywords
Funding Information
- European Research Council (ERC StG 2012_311751 BrainReadFBPredCode)
- Human Brain Project (EU Grant 604102 ContextDeepNet)
This publication has 77 references indexed in Scilit:
- Grey matter volume in early human visual cortex predicts proneness to the sound-induced flash illusionProceedings Of The Royal Society B-Biological Sciences, 2012
- How Does the Brain Solve Visual Object Recognition?Neuron, 2012
- Sound-Driven Synaptic Inhibition in Primary Visual CortexNeuron, 2012
- Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis toolsExperimental Brain Research, 2011
- Nonstimulated early visual areas carry information about surrounding contextProceedings of the National Academy of Sciences, 2010
- Onset timing of cross‐sensory activations and multisensory interactions in auditory and visual sensory corticesEuropean Journal of Neuroscience, 2010
- Feedback of visual object information to foveal retinotopic cortexNature Neuroscience, 2008
- In vivo two-photon voltage-sensitive dye imaging reveals top-down control of cortical layers 1 and 2 during wakefulnessProceedings of the National Academy of Sciences, 2008
- A cross‐modal system linking primary auditory and visual cortices: Evidence from intrinsic fMRI connectivity analysisHuman Brain Mapping, 2008
- Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and JudgmentsNeuron, 2008