“Um…, It’s Really Difficult to… Um… Speak Fluently”: Neural Tracking of Spontaneous Speech
Open Access
- 30 August 2023
- journal article
- research article
- Published by MIT Press in Neurobiology of Language
- Vol. 4 (3) , 435-454
Abstract
Spontaneous real-life speech is imperfect in many ways. It contains disfluencies and ill-formed utterances and has a highly variable rate. When listening to spontaneous speech, the brain needs to contend with these features in order to extract the speaker’s meaning. Here, we studied how the neural response is affected by four specific factors that are prevalent in spontaneous colloquial speech: (1) the presence of fillers, (2) the need to detect syntactic boundaries in disfluent speech, and (3) variability in speech rate. Neural activity was recorded (using electroencephalography) from individuals as they listened to an unscripted, spontaneous narrative, which was analyzed in a time-resolved fashion to identify fillers and detect syntactic boundaries. When considering these factors in a speech-tracking analysis, which estimates a temporal response function (TRF) to describe the relationship between the stimulus and the neural response it generates, we found that the TRF was affected by all of them. This response was observed for lexical words but not for fillers, and it had an earlier onset for opening words vs. closing words of a clause and for clauses with slower speech rates. These findings broaden ongoing efforts to understand neural processing of speech under increasingly realistic conditions. They highlight the importance of considering the imperfect nature of real-life spoken language, linking past research on linguistically well-formed and meticulously controlled speech to the type of speech that the brain actually deals with on a daily basis.Keywords
All Related Versions
Funding Information
- Ministry of Science and Technology, Israel (88962)
- Deutsche Forschungsgemeinschaft (490839860)
- Deutsche Forschungsgemeinschaft (490839860)
- Deutsche Forschungsgemeinschaft (411333557)
- Deutsche Forschungsgemeinschaft (490839860)
This publication has 98 references indexed in Scilit:
- Visual Input Enhances Selective Speech Envelope Tracking in Auditory Cortex at a “Cocktail Party”The Journal of Neuroscience, 2013
- The disfluent discourse: Effects of filled pauses on recallJournal of Memory and Language, 2011
- Representation of temporal sound features in the human auditory cortexReviews in the Neurosciences, 2011
- Cortical representation of the constituent structure of sentencesProceedings of the National Academy of Sciences, 2011
- FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological DataComputational Intelligence and Neuroscience, 2010
- Altering Context Speech Rate Can Cause Words to Appear or DisappearPsychological Science, 2010
- Breath Group Analysis for Reading and Spontaneous Speech in Healthy AdultsFolia Phoniatrica et Logopaedica, 2010
- Investigating the causes of wrap-up effects: Evidence from eye movements and E–Z ReaderCognition, 2009
- Punctuation and intonation effects on clause and sentence wrap-up: Evidence from eye movementsJournal of Memory and Language, 2006
- Perceptual adjustment to highly compressed speech: Effects of talker and rate changes.Journal of Experimental Psychology: Human Perception and Performance, 1997