Reversing the hands of time: Changing the mapping from seeing to saying.
Authors:
- Stefanie E. KuchinskySKStefanie E. Kuchinsky
- Kathryn BockKBKathryn Bock
- David E. IrwinDIDavid E. Irwin
- 1 January 2011
- journal article
- Published by American Psychological Association (APA) in Journal of Experimental Psychology: Learning, Memory, and Cognition
- Vol. 37 (3) , 748-756
Abstract
To describe a scene, speakers must map visual information to a linguistic plan. Eye movements capture features of this linkage in a tendency for speakers to fixate referents just before they are mentioned. The current experiment examined whether and how this pattern changes when speakers create atypical mappings. Eye movements were monitored as participants told the time from analog clocks. Half of the participants did this in the usual manner. For the other participants, the denotations of the clock hands were reversed, making the big hand the hour and the little hand the minute. Eye movements revealed that it was not the visual features or configuration of the hands that determined gaze patterns, but rather top-down control from upcoming referring expressions. Differences in eye-voice spans further suggested a process in which scene elements are relationally structured before a linguistic plan is executed. This provides evidence for structural rather than lexical incrementality in planning and supports a "seeing-for-saying" hypothesis in which the visual system is harnessed to the linguistic demands of an upcoming utterance.Keywords
Funding Information
- National Science Foundation (BCS-0214270; BCS-0132292)
- National Institutes of Health (R01 MH66089; T32 MH18990)
This publication has 6 references indexed in Scilit:
- Little houses and casas pequeñas: Message formulation and syntactic form in unscripted speech with speakers of English and SpanishCognition, 2008
- Prototypicality in sentence productionCognitive Psychology, 2008
- On the give and take between event apprehension and utterance formulationJournal of Memory and Language, 2007
- What the Eyes Say About SpeakingPsychological Science, 2000
- Effect of Ambiguity and Lexical Availability on Syntactic and Lexical ProductionCognitive Psychology, 2000
- Short-term conceptual memory for pictures.Journal of Experimental Psychology: Human Learning and Memory, 1976