Orienting Auditory Attention through Vision: the Impact of Monaural Listening
- 11 August 2021
- journal article
- research article
- Published by Walter de Gruyter GmbH in Multisensory Research
- Vol. 35 (1) , 1-28
Abstract
The understanding of linguistic messages can be made extremely complex by the simultaneous presence of interfering sounds, especially when they are also linguistic in nature. In two experiments, we tested if visual cues directing attention to spatial or temporal components of speech in noise can improve its identification. The hearing-in-noise task required identification of a five-digit sequence (target) embedded in a stream of time-reversed speech. Using a custom-built device located in front of the participant, we delivered visual cues to orient attention to the location of target sounds and/or their temporal window. In Exp. 1 ( ), we validated this visual-to-auditory cueing method in normal-hearing listeners, tested under typical binaural listening conditions. In Exp. 2 ( ), we assessed the efficacy of the same visual cues in normal-hearing listeners wearing a monaural ear plug, to study the effects of simulated monaural and conductive hearing loss on visual-to-auditory attention orienting. While Exp. 1 revealed a benefit of both spatial and temporal visual cues for hearing in noise, Exp. 2 showed that only the temporal visual cues remained effective during monaural listening. These findings indicate that when the acoustic experience is altered, visual-to-auditory attention orienting is more robust for temporal compared to spatial attributes of the auditory stimuli. These findings have implications for the relation between spatial and temporal attributes of sound objects, and when planning devices to orient audiovisual attention for subjects suffering from hearing loss.Keywords
Funding Information
- Libera Università di Bolzano (IT) GOST
- French Agence Nationale de la Recherche (ANR-16-CE17-0016, VIRTUALHEARING3D)
- Fondation Médisite
- Fondation Neurodis
- Ministero dell’Istruzione, dell’Università e della Ricerca (MUR, PRIN 20177894ZH)
This publication has 35 references indexed in Scilit:
- The Effects of Hearing Impairment and Aging on Spatial ProcessingEar & Hearing, 2013
- Social Competence, Sense of Loneliness, and Speech Intelligibility of Young Children With Hearing Loss in Individual Inclusion and Group InclusionJournal of Deaf Studies and Deaf Education, 2011
- Influence of Task-Relevant and Task-Irrelevant Feature Continuity on Selective Auditory AttentionJournal of the Association for Research in Otolaryngology, 2011
- Visual attention: The past 25 yearsVision Research, 2011
- Effects of Sensorineural Hearing Loss on Visually Guided Attention in a Multitalker EnvironmentJournal of the Association for Research in Otolaryngology, 2008
- Visually-guided Attention Enhances Target Identification in a Complex Auditory SceneJournal of the Association for Research in Otolaryngology, 2007
- Factors That Influence Intelligibility in Multitalker Speech DisplaysThe International Journal of Aviation Psychology, 2004
- Ventriloquist effect reinstates responsiveness to auditory stimuli in the ‘ignored’ space in patients with hemispatial neglectJournal of Clinical and Experimental Neuropsychology, 1995
- An Introduction to Unilateral Sensorineural Hearing Loss in ChildrenEar & Hearing, 1986
- Some Experiments on the Recognition of Speech, with One and with Two EarsThe Journal of the Acoustical Society of America, 1953