Spencer D. Kelly
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Spencer D. Kelly has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
Michael Hopkins
2 shared publicationsAngela L. Lee
Colgate University
1 shared publication- Aslı Özyürek
Centre for Language Studies, Radboud University, Nijmegen, Netherlands
1 shared publication Corinne Kravitz
1 shared publication- Emily Cullings
Colgate University, 13 Oak Drive, Department of East Asian Languages and Literatures, Hamilton, NY 13346, USA
1 shared publication - Jackie Burch
University of Rochester, 585 Elmwood Ave., Box 645, Rochester, NY 14642, USA
1 shared publication
Latest Publications
- 25 October 2011
- Published by Taylor & Francis in Language and Cognitive Processes
- Vol. 27 (6) , 793-807
When actions speak too much louder than words: Hand gestures disrupt word learning when phonetic demands are high
It is now widely accepted that hand gestures help people understand and learn language. Here, we provide an exception to this general rule—when phonetic demands are high, gesture actually hurts. Native English-speaking adults were instructed on the meaning of novel Japanese word pairs that were for non-native speakers phonetically hard (/ite/ vs. /itte/, which differ by only a geminate) or easy (/tate/ vs. /butta/, which differ by a geminate and also their segmental composition). The words were presented either with or without congruent iconic gestures, for example, “Ite means stay” (with a STAY gesture). After instruction, participants were given phonetic and vocabulary tests for the words they had learned. Although performance for the phonetic task was above chance for all conditions, gesture played different roles in the semantic task for easy and hard word pairs—it helped word learning for easy pairs, but it hurt for hard pairs. These results suggest that gesture and speech are semantically integrated during word learning, but only when phonetic demands are not too high.
- 25 October 2011
- Published by Taylor & Francis in Language and Cognitive Processes
- Vol. 27 (6) , 793-807
When actions speak too much louder than words: Hand gestures disrupt word learning when phonetic demands are high
It is now widely accepted that hand gestures help people understand and learn language. Here, we provide an exception to this general rule—when phonetic demands are high, gesture actually hurts. Native English-speaking adults were instructed on the meaning of novel Japanese word pairs that were for non-native speakers phonetically hard (/ite/ vs. /itte/, which differ by only a geminate) or easy (/tate/ vs. /butta/, which differ by a geminate and also their segmental composition). The words were presented either with or without congruent iconic gestures, for example, “Ite means stay” (with a STAY gesture). After instruction, participants were given phonetic and vocabulary tests for the words they had learned. Although performance for the phonetic task was above chance for all conditions, gesture played different roles in the semantic task for easy and hard word pairs—it helped word learning for easy pairs, but it hurt for hard pairs. These results suggest that gesture and speech are semantically integrated during word learning, but only when phonetic demands are not too high.
- 23 January 2009
- Published by Taylor & Francis in Language and Cognitive Processes
- Vol. 24 (2) , 313-334
Brief training with co-speech gesture lends a hand to word learning in a foreign language
Recent research in psychology and neuroscience has demonstrated that co-speech gestures are semantically integrated with speech during language comprehension and development. The present study explored whether gestures also play a role in language learning in adults. In Experiment 1, we exposed adults to a brief training session presenting novel Japanese verbs with and without hand gestures. Three sets of memory tests (at five minutes, two days and one week) showed that the greatest word learning occurred when gestures conveyed redundant imagistic information to speech. Experiment 2 was a preliminary investigation into possible neural correlates for such learning. We exposed participants to similar training sessions over three days and then measured event-related potentials (ERPs) to words learned with and without co-speech gestures. The main finding was that words learned with gesture produced a larger Late Positive Complex (indexing recollection) in bi-lateral parietal sites than words learned without gesture. However, there was no significant difference between the two conditions for the N400 component (indexing familiarity). The results have implications for pedagogical practices in foreign language instruction and theories of gesture-speech integration.
- 23 January 2009
- Published by Taylor & Francis in Language and Cognitive Processes
- Vol. 24 (2) , 313-334
Brief training with co-speech gesture lends a hand to word learning in a foreign language
Recent research in psychology and neuroscience has demonstrated that co-speech gestures are semantically integrated with speech during language comprehension and development. The present study explored whether gestures also play a role in language learning in adults. In Experiment 1, we exposed adults to a brief training session presenting novel Japanese verbs with and without hand gestures. Three sets of memory tests (at five minutes, two days and one week) showed that the greatest word learning occurred when gestures conveyed redundant imagistic information to speech. Experiment 2 was a preliminary investigation into possible neural correlates for such learning. We exposed participants to similar training sessions over three days and then measured event-related potentials (ERPs) to words learned with and without co-speech gestures. The main finding was that words learned with gesture produced a larger Late Positive Complex (indexing recollection) in bi-lateral parietal sites than words learned without gesture. However, there was no significant difference between the two conditions for the N400 component (indexing familiarity). The results have implications for pedagogical practices in foreign language instruction and theories of gesture-speech integration.
- 1 May 2008
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 123 (5_Suppleme) , 3325
Effects of hand gesture and lip movements on auditory learning of second language speech sounds
Previous research found that auditory training helps native English speakers to perceive phonemic vowel length distinction in Japanese, but that their performance has never reached native levels (Hirata et al., 2007). Given that multimodal information, such as hand gesture and lip movements, influences semantic aspects of language processing and development (Kelly et al., 2002), we examined whether this multimodal information helps to improve native English speakers' ability to perceive Japanese vowel length distinction. Forty‐five native English speakers participated in one of three types of training: (1) audio alone; (2) audio with hand gestures; and (3) audio with lip movements and hand gestures. Before and after training, participants were given phoneme perception tests that measured their ability to distinguish between short and long vowels in Japanese, e.g., /kato/ versus /kato:/. Our original prediction was that more modalities in training would result in greater learning. Although all three groups improved from pre‐ to post‐test, there were no significant differences among the three training groups. Unlike the original prediction, hand gestures and lip movements did not seem to augment learning of difficult sound distinctions. We will discuss possible benefits and limitations of using multimodal information in second language speech learning.
- 1 May 2008
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 123 (5_Suppleme) , 3325
Effects of hand gesture and lip movements on auditory learning of second language speech sounds
Previous research found that auditory training helps native English speakers to perceive phonemic vowel length distinction in Japanese, but that their performance has never reached native levels (Hirata et al., 2007). Given that multimodal information, such as hand gesture and lip movements, influences semantic aspects of language processing and development (Kelly et al., 2002), we examined whether this multimodal information helps to improve native English speakers' ability to perceive Japanese vowel length distinction. Forty‐five native English speakers participated in one of three types of training: (1) audio alone; (2) audio with hand gestures; and (3) audio with lip movements and hand gestures. Before and after training, participants were given phoneme perception tests that measured their ability to distinguish between short and long vowels in Japanese, e.g., /kato/ versus /kato:/. Our original prediction was that more modalities in training would result in greater learning. Although all three groups improved from pre‐ to post‐test, there were no significant differences among the three training groups. Unlike the original prediction, hand gestures and lip movements did not seem to augment learning of difficult sound distinctions. We will discuss possible benefits and limitations of using multimodal information in second language speech learning.
- 1 June 2007
- Published by Elsevier in Brain and Language
- Vol. 101 (3) , 222-233
An intentional stance modulates the integration of gesture and speech during comprehension
- 1 June 2007
- Published by Elsevier in Brain and Language
- Vol. 101 (3) , 222-233
An intentional stance modulates the integration of gesture and speech during comprehension
- 12 April 2007
- Published by Elsevier in Brain and Language
- Vol. 101 (3) , 181-184
Gesture, brain, and language
- 12 April 2007
- Published by Elsevier in Brain and Language
- Vol. 101 (3) , 181-184
Gesture, brain, and language
- 1 April 2004
- Published by Elsevier in Brain and Language
- Vol. 89 (1) , 253-260
Neural correlates of bimodal speech and gesture comprehension
- 1 April 2004
- Published by Elsevier in Brain and Language
- Vol. 89 (1) , 253-260
Neural correlates of bimodal speech and gesture comprehension
- 1 February 2003
- Published by Cambridge University Press (CUP) in Behavioral and Brain Sciences
- Vol. 26 (2) , 230-231
From past to present: Speech, gesture, and brain in present-day human communication
This commentary presents indirect support for Corballis's claim that language evolved out of a gestural system in our evolutionary past. Specifically, it presents behavioral and neurological evidence that present-day speech and gesture continue to be tightly integrated in language production and comprehension.
- 1 February 2003
- Published by Cambridge University Press (CUP) in Behavioral and Brain Sciences
- Vol. 26 (2) , 230-231
From past to present: Speech, gesture, and brain in present-day human communication
This commentary presents indirect support for Corballis's claim that language evolved out of a gestural system in our evolutionary past. Specifically, it presents behavioral and neurological evidence that present-day speech and gesture continue to be tightly integrated in language production and comprehension.
- 1 August 2002
- Published by Taylor & Francis in Developmental Neuropsychology
- Vol. 22 (1) , 323-349
Putting Language Back in the Body: Speech and Gesture on Three Time Frames
This article investigates the role that nonverbal actions play in language processing over 3 different time frames. First, we speculate that nonverbal actions played a role in how formal language systems emerged from our primate ancestors over evolutionary time. Next, we hypothesize that if nonverbal behaviors played a foundational role in the emergence of language over evolution, these actions should influence how children learn language in the present. Finally, we argue that nonverbal actions continue to play a role for adults in the moment-to-moment processing of language. Throughout, we take an embodied view of language and argue that the neural, cognitive, and social components of language processing are firmly grounded in bodily action.
- 1 August 2002
- Published by Taylor & Francis in Developmental Neuropsychology
- Vol. 22 (1) , 323-349
Putting Language Back in the Body: Speech and Gesture on Three Time Frames
This article investigates the role that nonverbal actions play in language processing over 3 different time frames. First, we speculate that nonverbal actions played a role in how formal language systems emerged from our primate ancestors over evolutionary time. Next, we hypothesize that if nonverbal behaviors played a foundational role in the emergence of language over evolution, these actions should influence how children learn language in the present. Finally, we argue that nonverbal actions continue to play a role for adults in the moment-to-moment processing of language. Throughout, we take an embodied view of language and argue that the neural, cognitive, and social components of language processing are firmly grounded in bodily action.