Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words
- 1 December 2008
- journal article
- research article
- Published by Taylor & Francis in Cognitive Neuropsychology
- Vol. 25 (7-8) , 1114-1128
Abstract
We report two experiments that provide converging behavioural and neurophysiological evidence on the relationship between the meaning of iconic gestures and words. Experiment 1 exploited a semantic priming paradigm and revealed interference between gestures and words when they were not related in meaning, but no facilitation when they were. This result was confirmed in Experiment 2, where ERPs were recorded during silent word reading with the same paradigm. The analysis showed a negative deflection peaking near 400 ms (N400) and, in the left hemisphere, greater negative values for verbs than for nouns. Differently from the classical distribution obtained with verbal stimuli, we found an N400 that spread more over central-anterior areas of the scalp, suggesting that the meaning systems of gesture and language do not overlap completely. These results are consistent with the view that the meaning systems for gesture and speech are tightly integrated.Keywords
This publication has 48 references indexed in Scilit:
- Further investigation on the mnemonic effect of gestures: Their meaning mattersThe European Journal of Cognitive Psychology, 2006
- Grammatical Subjects in home sign: Abstract linguistic structure in adult primary gesture systems without linguistic inputProceedings of the National Academy of Sciences, 2005
- Gesture and the process of speech production: We think, therefore we gestureLanguage and Cognitive Processes, 2000
- Illuminating Mental Representations Through Speech and GesturePsychological Science, 1999
- The function of gesture in learning to count: more than keeping trackCognitive Development, 1999
- The Processing Nature of the N400: Evidence from Masked PrimingJournal of Cognitive Neuroscience, 1993
- Event-related potentials and the semantic matching of picturesBrain and Cognition, 1990
- Gesture, speech, and computational stages: A reply to McNeill.Psychological Review, 1989
- The mismatch between gesture and speech as an index of transitional knowledgeCognition, 1986
- Event-related potentials, lexical decision and semantic primingElectroencephalography and Clinical Neurophysiology, 1985