An ALE meta‐analysis on the audiovisual integration of speech signals
- 4 July 2014
- journal article
- review article
- Published by Wiley in Human Brain Mapping
- Vol. 35 (11) , 5587-5605
Abstract
The brain improves speech processing through the integration of audiovisual (AV) signals. Situations involving AV speech integration may be crudely dichotomized into those where auditory and visual inputs contain (1) equivalent, complementary signals (validating AV speech) or (2) inconsistent, different signals (conflicting AV speech). This simple framework may allow the systematic examination of broad commonalities and differences between AV neural processes engaged by various experimental paradigms frequently used to study AV speech integration. We conducted an activation likelihood estimation metaanalysis of 22 functional imaging studies comprising 33 experiments, 311 subjects, and 347 foci examining “conflicting” versus “validating” AV speech. Experimental paradigms included content congruency, timing synchrony, and perceptual measures, such as the McGurk effect or synchrony judgments, across AV speech stimulus types (sublexical to sentence). Colocalization of conflicting AV speech experiments revealed consistency across at least two contrast types (e.g., synchrony and congruency) in a network of dorsal stream regions in the frontal, parietal, and temporal lobes. There was consistency across all contrast types (synchrony, congruency, and percept) in the bilateral posterior superior/middle temporal cortex. Although fewer studies were available, validating AV speech experiments were localized to other regions, such as ventral stream visual areas in the occipital and inferior temporal cortex. These results suggest that while equivalent, complementary AV speech signals may evoke activity in regions related to the corroboration of sensory input, conflicting AV speech signals recruit widespread dorsal stream areas likely involved in the resolution of conflicting sensory signals. Hum Brain Mapp 35:5587–5605, 2014. © 2014 Wiley Periodicals, Inc.Keywords
Funding Information
- National Science Foundation (NSF) Graduate Research Fellowship Program (DGE-0903443, DGE-1444316)
- National Institutes of Health (NIH) (KL2TR000102, R01EY018923)
- NSF PIRE grant (OISE-0730255)
- NIH Training Grant (T32 NS041231 (L.C.E.))
This publication has 120 references indexed in Scilit:
- A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusionNeuroImage, 2012
- Discrete neural substrates underlie complementary audiovisual speech integration processesNeuroImage, 2011
- An expanded role for the dorsal auditory pathway in sensorimotor control and integrationHearing Research, 2011
- Localization of sublexical speech perception componentsBrain and Language, 2010
- Comparison of the disparity between Talairach and MNI coordinates in functional neuroimaging data: Validation of the Lancaster transformNeuroImage, 2010
- Neural processing of asynchronous audiovisual speech perceptionNeuroImage, 2010
- Coordinate‐based activation likelihood estimation meta‐analysis of neuroimaging data: A random‐effects approach based on empirical estimates of spatial uncertaintyHuman Brain Mapping, 2009
- Touch, sound and vision in human superior temporal sulcusNeuroImage, 2008
- Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and JudgmentsNeuron, 2008
- Bias between MNI and Talairach coordinates analyzed using the ICBM‐152 brain templateHuman Brain Mapping, 2007