The communicative advantage: how kinematic signaling supports semantic comprehension
Open Access
- 11 May 2019
- journal article
- research article
- Published by Springer Nature in Psychological Research
- Vol. 84 (7) , 1897-1911
Abstract
Humans are unique in their ability to communicate information through representational gestures which visually simulate an action (eg. moving hands as if opening a jar). Previous research indicates that the intention to communicate modulates the kinematics (e.g., velocity, size) of such gestures. If and how this modulation influences addressees’ comprehension of gestures have not been investigated. Here we ask whether communicative kinematic modulation enhances semantic comprehension (i.e., identification) of gestures. We additionally investigate whether any comprehension advantage is due to enhanced early identification or late identification. Participants (n = 20) watched videos of representational gestures produced in a more- (n = 60) or less-communicative (n = 60) context and performed a forced-choice recognition task. We tested the isolated role of kinematics by removing visibility of actor’s faces in Experiment I, and by reducing the stimuli to stick-light figures in Experiment II. Three video lengths were used to disentangle early identification from late identification. Accuracy and response time quantified main effects. Kinematic modulation was tested for correlations with task performance. We found higher gesture identification performance in more- compared to less-communicative gestures. However, early identification was only enhanced within a full visual context, while late identification occurred even when viewing isolated kinematics. Additionally, temporally segmented acts with more post-stroke holds were associated with higher accuracy. Our results demonstrate that communicative signaling, interacting with other visual cues, generally supports gesture identification, while kinematic modulation specifically enhances late identification in the absence of other cues. Results provide insights into mutual understanding processes as well as creating artificial communicative agents.Keywords
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (2014.WP4.PhD.RUN.014)
This publication has 47 references indexed in Scilit:
- Human Sensorimotor Communication: A Theory of Signaling in Online Social InteractionsPLOS ONE, 2013
- Make a gesture and I will tell you what you are miming. Pantomime recognition in healthy subjectsCortex, 2012
- Online prediction of others’ actions: the contribution of the target object, action context and movement kinematicsPsychological Research, 2012
- Recipient design in human communication: simple heuristics or perspective taking?Frontiers in Human Neuroscience, 2012
- Grasping intentions: from thought experiments to empirical evidenceFrontiers in Human Neuroscience, 2012
- rTMS for TinnitusFrontiers in Human Neuroscience, 2012
- Gesturing on the telephone: Independent effects of dialogue and visibilityJournal of Memory and Language, 2008
- Grasping the Intentions of Others with One's Own Mirror Neuron SystemPLOS Biology, 2005
- Linguistic influences on gesture’s formGesture, 2005
- Evidence for ‘motionese’: modifications in mothers’ infant‐directed actionDevelopmental Science, 2002