Assessing the effect of questionnaire design on unit and item-nonresponse: evidence from an online experiment
Authors:
Open Access
- 2 August 2021
- journal article
- research article
- Published by Taylor & Francis in International Journal of Social Research Methodology
- Vol. 25 (5) , 659-672
Abstract
Questionnaire design choices, such as handling ‘do not know’ answers or using check all that apply questions may impact the level of item- and unit nonresponse. We used experimental data from an online panel and the questions of ESS to examine how applying forced answering, offering DK/NA options and specific question formats (CATA vs. forced choice format) impact the level of nonresponse and how respondent characteristics correlate with these effects. The results suggest that neither forcing respondents nor offering an explicit NR option is advisable, as these options strongly increase nonresponse. Rather a skipping-allowed design is a more reasonable choice. Those who were interested in the topic of the survey were far less sensitive to NR handling. Developing adaptive questionnaire designs based on topic interest can be a promising direction for future research.Keywords
Funding Information
- xxx
This publication has 42 references indexed in Scilit:
- Designing Web Surveys in Marketing Research: Does Use of Forced Answering Affect Completion Rates?Journal of Marketing Theory and Practice, 2010
- Using Questionnaire Design to Fight Nonresponse Bias in Web SurveysSocial Science Computer Review, 2010
- Open-Ended Questions in Web SurveysPublic Opinion Quarterly, 2009
- Forced‐response in online surveys: Bias from reactance and an increase in sex‐specific dropoutJournal of the American Society for Information Science and Technology, 2007
- Color, Labels, and Interpretive Heuristics for Response ScalesPublic Opinion Quarterly, 2007
- Comparing Check-All and Forced-Choice Question Formats in Web SurveysPublic Opinion Quarterly, 2006
- Designing a Strategy for Reducing “No Opinion” Responses in Web-Based SurveysSocial Science Computer Review, 2002
- The Impact of Age and Education on Response Order Effects in Attitude MeasurementPublic Opinion Quarterly, 1999
- Los Cinco Grandes across cultures and ethnic groups: Multitrait-multimethod analyses of the Big Five in Spanish and English.Journal of Personality and Social Psychology, 1998
- Response strategies for coping with the cognitive demands of attitude measures in surveysApplied Cognitive Psychology, 1991