A Coding System with Independent Annotations of Gesture Forms and Functions During Verbal Communication: Development of a Database of Speech and GEsture (DoSaGE)
- 25 September 2014
- journal article
- research article
- Published by Springer Nature in Journal of Nonverbal Behavior
- Vol. 39 (1) , 93-111
Abstract
Gestures are commonly used together with spoken language in human communication. One major limitation of gesture investigations in the existing literature lies in the fact that the coding of forms and functions of gestures has not been clearly differentiated. This paper first described a recently developed Database of Speech and GEsture based on independent annotation of gesture forms and functions among 119 neurologically unimpaired right-handed native speakers of Cantonese (divided into three age and two education levels), and presented findings of an investigation examining how gesture use was related to age and linguistic performance. Consideration of these two factors, for which normative data are currently very limited or lacking in the literature, is relevant and necessary when one evaluates gesture employment among individuals with and without language impairment. Three speech tasks, including monologue of a personally important event, sequential description, and story-telling, were used for elicitation. The EUDICO Linguistic ANnotator software was used to independently annotate each participant’s linguistic information of the transcript, forms of gestures used, and the function for each gesture. About one-third of the subjects did not use any co-verbal gestures. While the majority of gestures were non-content-carrying, which functioned mainly for reinforcing speech intonation or controlling speech flow, the content-carrying ones were used to enhance speech content. Furthermore, individuals who are younger or linguistically more proficient tended to use fewer gestures, suggesting that normal speakers gesture differently as a function of age and linguistic performance.Keywords
This publication has 37 references indexed in Scilit:
- Age-related changes in co-speech gesture and narrative: Evidence from French children and adultsSpeech Communication, 2010
- Gesture and the process of speech production: We think, therefore we gestureLanguage and Cognitive Processes, 2000
- Iconic hand gestures and the predictability of words in context in spontaneous speechBritish Journal of Psychology, 2000
- Mapping the Range of Information Contained in the Iconic Hand Gestures that Accompany Spontaneous SpeechJournal of Language and Social Psychology, 1999
- Mental Imagery and Production of Hand Gestures While Speaking in Younger and Older AdultsJournal of Nonverbal Behavior, 1999
- The function of gesture in learning to count: more than keeping trackCognitive Development, 1999
- Gestures at Work in Sense-Making Science TalkJournal of the Learning Sciences, 1996
- The role of gestures in description-communication: A cross-sectional study of agingJournal of Nonverbal Behavior, 1996
- Gesture, speech, and computational stages: A reply to McNeill.Psychological Review, 1989
- The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and CodingSemiotica, 1969