An fMRI Study of Audiovisual Speech Perception Reveals Multisensory Interactions in Auditory Cortex
Open Access
- 21 June 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 8 (6) , e68959
Abstract
Research on the neural basis of speech-reading implicates a network of auditory language regions involving inferior frontal cortex, premotor cortex and sites along superior temporal cortex. In audiovisual speech studies, neural activity is consistently reported in posterior superior temporal Sulcus (pSTS) and this site has been implicated in multimodal integration. Traditionally, multisensory interactions are considered high-level processing that engages heteromodal association cortices (such as STS). Recent work, however, challenges this notion and suggests that multisensory interactions may occur in low-level unimodal sensory cortices. While previous audiovisual speech studies demonstrate that high-level multisensory interactions occur in pSTS, what remains unclear is how early in the processing hierarchy these multisensory interactions may occur. The goal of the present fMRI experiment is to investigate how visual speech can influence activity in auditory cortex above and beyond its response to auditory speech. In an audiovisual speech experiment, subjects were presented with auditory speech with and without congruent visual input. Holding the auditory stimulus constant across the experiment, we investigated how the addition of visual speech influences activity in auditory cortex. We demonstrate that congruent visual speech increases the activity in auditory cortex.Keywords
This publication has 44 references indexed in Scilit:
- A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusionNeuroImage, 2012
- Normalization as a canonical neural computationNature Reviews Neuroscience, 2011
- Dynamic Changes in Superior Temporal Sulcus Connectivity during Perception of Noisy Audiovisual SpeechJournal of Neuroscience, 2011
- Speech Production as State Feedback ControlFrontiers in Human Neuroscience, 2011
- fMRI-Guided Transcranial Magnetic Stimulation Reveals That the Superior Temporal Sulcus Is a Cortical Locus of the McGurk EffectThe Journal of Neuroscience, 2010
- Visual influences on ferret auditory cortexHearing Research, 2009
- The neural basis of multisensory integration in the midbrain: Its organization and maturationHearing Research, 2009
- Lip-Reading Aids Word Recognition Most in Moderate Noise: A Bayesian Explanation Using High-Dimensional Feature SpacePLOS ONE, 2009
- Two cortical mechanisms support the integration of visual and auditory speech: A hypothesis and preliminary dataNeuroscience Letters, 2009
- The processing of audio-visual speech: empirical and neural basesPhilosophical Transactions of the Royal Society B: Biological Sciences, 2007