The Primacy of Multimodal Alignment in Converging on Shared Symbols for Novel Referents
Open Access
- 16 March 2022
- journal article
- research article
- Published by Taylor & Francis in Discourse Processes
- Vol. 59 (3) , 209-236
Abstract
When people interact to establish shared symbols for novel objects or concepts, they often rely on multiple communicative modalities as well as on alignment (i.e., cross-participant repetition of communicative behavior). Yet these interactional resources have rarely been studied together, so little is known about if and how people combine multiple modalities in alignment to achieve joint reference. To investigate this, we systematically track the emergence of lexical and gestural alignment in a referential communication task with novel objects. Quantitative analyses reveal that people frequently use a combination of lexical and gestural alignment, and that such multimodal alignment tends to emerge earlier compared to unimodal alignment. Qualitative analyses of the interactional contexts in which alignment emerges reveal how people flexibly deploy lexical and gestural alignment in line with modality affordances and communicative needs.Keywords
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (016.vidi.185.205)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (024.001.006)
This publication has 55 references indexed in Scilit:
- How to Bootstrap a Human Communication SystemCognitive Science, 2013
- When do gestures communicate? A meta-analysis.Psychological Bulletin, 2011
- SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitlesBehavior Research Methods, 2010
- Two Sides of the Same CoinPsychological Science, 2009
- Gesture Paves the Way for Language DevelopmentPsychological Science, 2005
- The use of lexical and syntactic information in language production: Evidence from the priming of noun-phrase structureJournal of Memory and Language, 2003
- What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speakingJournal of Memory and Language, 2003
- Saying what you mean in dialogue: A study in conceptual and semantic co-ordinationCognition, 1987
- Referring as a collaborative processCognition, 1986
- Concurrent feedback, confirmation, and the encoding of referents in verbal communication.Journal of Personality and Social Psychology, 1966