Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding
Authors:
- Mirta GalesicMGMirta Galesic
- Roger TourangeauRTRoger Tourangeau
- Mick P. CouperMCMick P. Couper
- Frederick G. ConradFCFrederick G. Conrad
Open Access
- 1 December 2008
- journal article
- Published by Oxford University Press (OUP) in Public Opinion Quarterly
- Vol. 72 (5) , 892-913
Abstract
Survey researchers since Cannell have worried that respondents may take various shortcuts to reduce the effort needed to complete a survey. The evidence for such shortcuts is often indirect. For instance, preferences for earlier versus later response options have been interpreted as evidence that respondents do not read beyond the first few options. This is really only a hypothesis, however, that is not supported by direct evidence regarding the allocation of respondent attention. In the current study, we used a new method to more directly observe what respondents do and do not look at by recording their eye movements while they answered questions in a Web survey. The eye-tracking data indicate that respondents do in fact spend more time looking at the first few options in a list of response options than those at the end of the list; this helps explain their tendency to select the options presented first regardless of their content. In addition, the eye-tracking data reveal that respondents are reluctant to invest effort in reading definitions of survey concepts that are only a mouse click away or paying attention to initially hidden response options. It is clear from the eye-tracking data that some respondents are more prone to these and other cognitive shortcuts than others, providing relatively direct evidence for what had been suspected based on more conventional measures.Keywords
This publication has 22 references indexed in Scilit:
- Editor's NotePublic Opinion Quarterly, 2006
- Picture This!: Exploring Visual Effects in Web SurveysPublic Opinion Quarterly, 2004
- Integrating text and pictorial information: Eye movements when looking at print advertisements.Journal of Experimental Psychology: Applied, 2001
- Integrating text and pictorial information: Eye movements when looking at print advertisements.Journal of Experimental Psychology: Applied, 2001
- SURVEY RESEARCHAnnual Review of Psychology, 1999
- Eye movements in reading and information processing: 20 years of research.Psychological Bulletin, 1998
- The Impact of Candidate Name Order on Election OutcomesPublic Opinion Quarterly, 1998
- Does Conversational Interviewing Reduce Survey Measurement Error?Public Opinion Quarterly, 1997
- Response strategies for coping with the cognitive demands of attitude measures in surveysApplied Cognitive Psychology, 1991
- A theory of reading: From eye fixations to comprehension.Psychological Review, 1980