Multimodal Development in Children's Narrative Speech: Evidence for Tight Gesture–Speech Temporal Alignment Patterns as Early as 5 Years Old
- 7 March 2023
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66 (3) , 888-900
Abstract
Purpose: This study aims to analyze the development of gesture–speech temporal alignment patterns in children's narrative speech from a longitudinal perspective and, specifically, the potential differences between different gesture types, namely, gestures that imagistically portray or refer to semantic content in speech (i.e., referential gestures) and those that lack semantic content (i.e., non-referential gestures). Method: This study uses an audiovisual corpus of narrative productions ( n = 332) from 83 children (43 girls, 40 boys) who participated in a narrative retelling task at two time points in development (at 5–6 and 7–9 years of age). The 332 narratives were coded for both manual co-speech gesture types and prosody. Gestural annotations included gesture phasing (i.e., preparation, stroke, hold, and recovery) and gesture types (in terms of referentiality, i.e., referential and non-referential), whereas prosodic annotations included pitch-accented syllables. Results: Results revealed that by ages 5–6 years, children already temporally aligned the stroke of both referential and non-referential gestures with pitch-accented syllables, showing no significant differences between these two gesture types. Conclusions: The results of the present study contribute to the view that both referential and non-referential gestures are aligned with pitch accentuation, and therefore, this is not only a characteristic of non-referential gestures. Our results also add support to McNeill's phonological synchronization rule from a developmental perspective and indirectly back up recent theories about the biomechanics of gesture–speech alignment, suggesting that this is an inherent ability of oral communication.Keywords
This publication has 35 references indexed in Scilit:
- The temporal relation between beat gestures and speechLanguage and Cognitive Processes, 2011
- Is there really an asymmetry in the acquisition of the focus-to-accentuation mapping?Lingua, 2010
- Computing inter‐rater reliability and its variance in the presence of high agreementBritish Journal of Mathematical and Statistical Psychology, 2008
- The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perceptionJournal of Memory and Language, 2007
- Aspects of rhythm in gesture and speechGesture, 2007
- Co‐occurences of preverbal vocal behavior and motor action in early infancyDevelopmental Science, 2001
- Gesture and the transition from one- to two-word speech: when hand and mouth come together2000
- Gesture and early bilingual development.Developmental Psychology, 1999
- High agreement but low kappa: II. Resolving the paradoxesJournal of Clinical Epidemiology, 1990
- High agreement but low Kappa: I. the problems of two paradoxesJournal of Clinical Epidemiology, 1990