Superadditive Responses in Superior Temporal Sulcus Predict Audiovisual Benefits in Object Categorization
Open Access
- 18 November 2009
- journal article
- research article
- Published by Oxford University Press (OUP) in Cerebral Cortex
- Vol. 20 (8) , 1829-1842
Abstract
Merging information from multiple senses provides a more reliable percept of our environment. Yet, little is known about where and how various sensory features are combined within the cortical hierarchy. Combining functional magnetic resonance imaging and psychophysics, we investigated the neural mechanisms underlying integration of audiovisual object features. Subjects categorized or passively perceived audiovisual object stimuli with the informativeness (i.e., degradation) of the auditory and visual modalities being manipulated factorially. Controlling for low-level integration processes, we show higher level audiovisual integration selectively in the superior temporal sulci (STS) bilaterally. The multisensory interactions were primarily subadditive and even suppressive for intact stimuli but turned into additive effects for degraded stimuli. Consistent with the inverse effectiveness principle, auditory and visual informativeness determine the profile of audiovisual integration in STS similarly to the influence of physical stimulus intensity in the superior colliculus. Importantly, when holding stimulus degradation constant, subjects’ audiovisual behavioral benefit predicts their multisensory integration profile in STS: only subjects that benefit from multisensory integration exhibit superadditive interactions, while those that do not benefit show suppressive interactions. In conclusion, superadditive and subadditive integration profiles in STS are functionally relevant and related to behavioral indices of multisensory integration with superadditive interactions mediating successful audiovisual object categorization.Keywords
This publication has 71 references indexed in Scilit:
- Multisensory interactions in primate auditory cortex: fMRI and electrophysiologyHearing Research, 2009
- Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectivenessExperimental Brain Research, 2009
- Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognitionNeuroImage, 2009
- Multisensory Integration in Macaque Visual Cortex Depends on Cue ReliabilityNeuron, 2008
- Interactions between the Superior Temporal Sulcus and Auditory Cortex Mediate Dynamic Face/Voice Integration in Rhesus MonkeysThe Journal of Neuroscience, 2008
- Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and JudgmentsNeuron, 2008
- Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory CorticesJournal of Neuroscience, 2007
- Integration of Auditory and Visual Communication Information in the Primate Ventrolateral Prefrontal CortexThe Journal of Neuroscience, 2006
- Distinct Cortical Pathways for Processing Tool versus Animal SoundsThe Journal of Neuroscience, 2005
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002