Effects of Design in Web Surveys
Authors:
- Vera ToepoelVTVera Toepoel
- Marcel DasMDMarcel Das
- Arthur Van SoestASArthur Van Soest
- 25 November 2008
- journal article
- Published by Oxford University Press (OUP) in Public Opinion Quarterly
- Vol. 72 (5) , 985-1007
Abstract
In this paper, we investigate whether there are differences in the effect of instrument design between trained and fresh respondents. In three experiments, we varied the number of items on a screen, the choice of response categories, and the layout of a five-point rating scale. In general, effects of design carry over between trained and fresh respondents. We found little evidence that survey experience influences the question-answering process. Trained respondents seem to be more sensitive to satisficing. The shorter completion time, higher interitem correlations for multiple-item-per-screen formats, and the fact that they select the first response options more often indicate that trained respondents tend to take shortcuts in the response process and study the questions less carefully.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Bias and Changes in Perceived Intensity of Verbal Qualifiers Effected by Scale Orientation2007
- The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered QuestionsPublic Opinion Quarterly, 2004
- A Reliability Generalization Study of the Marlowe-Crowne Social Desirability ScaleEducational and Psychological Measurement, 2002
- Web Survey Design and AdministrationPublic Opinion Quarterly, 2001
- Web SurveysPublic Opinion Quarterly, 2000
- Panel Effects in the American National Election StudiesPolitical Analysis, 1999
- Towards a Theory of Self‐Administered Questionnaire Design1997
- Measuring Social Desirability: Short Forms of the Marlowe-Crowne Social Desirability ScaleEducational and Psychological Measurement, 1993
- Research Notes: The Effects of Research on Participants: Findings from a Study of Mothers and EmploymentThe Sociological Review, 1993
- The dynamics of household travel time expenditures and car ownership decisionsTransportation Research Part A: General, 1990