Semantic Congruency Modulates the Effect of Attentional Load on the Audiovisual Integration of Animate Images and Sounds
Authors:
- Qiong WuQWQiong Wu
- Yiyang YuYYYiyang Yu
- Fengxia WuFWFengxia Wu
- Satoshi TakahashiSTSatoshi Takahashi
- Yoshimichi EjimaYEYoshimichi Ejima
- Jiajia YangJYJiajia Yang
- Jinglong WuJWJinglong Wu
Open Access
- 1 November 2020
- journal article
- research article
- Published by SAGE Publications in I-Perception
- Vol. 11 (6)
Abstract
Attentional processes play a complex and multifaceted role in the integration of input from different sensory modalities. However, whether increased attentional load disrupts the audiovisual (AV) integration of common objects that involve semantic content remains unclear. Furthermore, knowledge regarding how semantic congruency interacts with attentional load to influence the AV integration of common objects is limited. We investigated these questions by examining AV integration under various attentional-load conditions. AV integration was assessed by adopting an animal identification task using unisensory (animal images and sounds) and AV stimuli (semantically congruent AV objects and semantically incongruent AV objects), while attentional load was manipulated by using a rapid serial visual presentation task. Our results indicate that attentional load did not attenuate the integration of semantically congruent AV objects. However, semantically incongruent animal sounds and images were not integrated (as there was no multisensory facilitation), and the interference effect produced by the semantically incongruent AV objects was reduced by increased attentional-load manipulations. These findings highlight the critical role of semantic congruency in modulating the effect of attentional load on the AV integration of common objects.Keywords
Funding Information
- the Social Science project of Suzhou University of science and Technology (332012902, 341922905)
- Japan Society for the Promotion of Science (JSPS) Kakenhi (18H05009, 17K18855, 18H01411, 18K12149)
This publication has 66 references indexed in Scilit:
- Attention Distributed across Sensory Modalities Enhances Perceptual PerformanceJournal of Neuroscience, 2012
- Current perspectives and methods in studying neural mechanisms of multisensory interactionsNeuroscience & Biobehavioral Reviews, 2012
- Vision and Audition Do Not Share Attentional Resources in Sustained TasksFrontiers in Psychology, 2011
- The multifaceted interplay between attention and multisensory integrationTrends in Cognitive Sciences, 2010
- Multisensory conflict modulates the spread of visual attention across a multisensory objectNeuroImage, 2010
- Semantic confusion regarding the development of multisensory integration: a practical solutionEuropean Journal of Neuroscience, 2010
- Capturing spatial attention with multisensory cues: A reviewHearing Research, 2009
- Suppression of multisensory integration by modality-specific attention in agingNeuroReport, 2009
- Binding crossmodal object features in perirhinal cortexProceedings of the National Academy of Sciences, 2006
- Separate attentional resources for vision and auditionProceedings Of The Royal Society B-Biological Sciences, 2006