Young children rely on visual information to process degraded speech: Evidence from behavioural and neuroimaging measures
Preprint
Abstract
Young children acquire language in environments where speech is often acoustically degraded, yet little is known about how developing brains adapt to reduced speech intelligibility. Using a combination of eye-tracking and functional near-infrared spectroscopy (fNIRS), we investigated young children’s attentional allocation to a speaking face at varying levels of speech intelligibility and the brain activity supporting this behaviour during development. Infants (8–10 months) and toddlers (27–30 months) viewed videos of a speaker in three conditions: producing clear speech, spectrally degraded (vocoded) speech, and silent (audio muted) speech. Visual attention to the speaker’s mouth increased when speech was degraded relative to clear speech in both age groups, indicating an early-emerging compensatory strategy. However, this shared behavioural response was supported by brain activity that differed by age. Degraded speech elicited greater recruitment of prefrontal regions associated with effortful listening, particularly in infants, whereas toddlers showed stronger engagement of posterior temporal regions implicated in audiovisual integration. In response to silent speech, there was no evidence for increased visual attention to the mouth compared to the clear speech condition, but there was reduced temporal activation and increased prefrontal brain responses, especially in infants. Together, these findings suggest that experience with audiovisual correspondences and linguistic maturity contribute to a more efficient processing of speech, particularly relevant when speech is degraded. By combining behavioural and neuroimaging measures, this study advances mechanistic accounts of audiovisual speech processing and provides insights relevant to populations experiencing spectrally degraded input, such as children using cochlear implants.Keywords
Funding Information
- UKRI Future Leaders Fellowship (MR/S018425/1)
This publication has 61 references indexed in Scilit:
- Watching talking faces: The development of cortical representation of visual syllables in infancyBrain and Language, 2023
- Investigating Cortical Responses to Noise-Vocoded Speech in Children with Normal Hearing Using Functional Near-Infrared Spectroscopy (fNIRS)Journal of the Association for Research in Otolaryngology, 2021
- Selective attention to the mouth of a talker in Japanese-learning infants and toddlers: Its relationship with vocabulary and compensation for noiseCortex, 2021
- Modality-independent recruitment of inferior frontal cortex during speech processing in human infantsDevelopmental Cognitive Neuroscience, 2018
- Audiovisual Speech Integration2016
- An ALE meta‐analysis on the audiovisual integration of speech signalsHuman Brain Mapping, 2014
- Eye contrast polarity is critical for face recognition by infantsJournal of Experimental Child Psychology, 2013
- Language or music, mother or Mozart? Structural and environmental influences on infants’ language networksBrain and Language, 2010
- Hearing speech sounds: Top-down influences on the interface between audition and speech perceptionHearing Research, 2007
- Methods of Quantitating Cerebral Near Infrared Spectroscopy Data1988