Co-Speech Hand Gestures Are Used to Predict Upcoming Meaning
Open Access
- 22 April 2025
- journal article
- Published by SAGE Publications in Psychological Science
- Vol. 36 (4) , 237-248
Abstract
In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders’ language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., “type”). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.Keywords
Funding Information
- European Research Council (773079)
- Max-Planck-Gesellschaft
This publication has 38 references indexed in Scilit:
- Multimodal language processing: How preceding discourse constrains gesture interpretation and affects gesture integration when gestures do not synchronise with semantic affiliatesJournal of Memory and Language, 2021
- Commonalities in alpha and beta neural desynchronizations during prediction in language comprehension and productionCortex, 2020
- The Relation between Alpha/Beta Oscillations and the Encoding of Sentence induced Contextual InformationScientific Reports, 2019
- Multimodal Language Processing in Human CommunicationTrends in Cognitive Sciences, 2019
- Predicting while comprehending language: A theory and review.Psychological Bulletin, 2018
- Four central questions about prediction in language processingBrain Research, 2015
- Transitions in neural oscillations reflect prediction errors generated in audiovisual speechNature Neuroscience, 2011
- Speech-and-gesture integration in high functioning autismCognition, 2010
- Nonparametric statistical testing of EEG- and MEG-dataJournal of Neuroscience Methods, 2007
- Brain potentials during reading reflect word expectancy and semantic associationNature, 1984