Responsive Survey Designs for Reducing Nonresponse Bias
Open Access
- 1 September 2017
- journal article
- research article
- Published by SAGE Publications in Journal of Official Statistics
- Vol. 33 (3) , 735-752
Abstract
Survey researchers have been investigating alternative approaches to reduce data collection costs while mitigating the risk of nonresponse bias or to produce more accurate estimates within the same budget. Responsive or adaptive design has been suggested as one means for doing this. Falling survey response rates and the need to find effective ways of implementing responsive design has focused attention on the relationship between response rates and nonresponse bias. In our article, we re-examine the data compiled by Groves and Peytcheva (2008) in their influential article and show there is an important between-study component of variance in addition to the within-study variance highlighted in the original analysis. We also show that theory implies that raising response rates can help reduce the nonresponse bias on average across the estimates within a study. We then propose a typology of response propensity models that help explain the empirical findings, including the relative weak relationship between nonresponse rates and nonresponse bias. Using these results, we explore when responsive design tools such as switching modes, giving monetary incentives, and increasing the level of effort are likely to be effective. We conclude with some comments on the use of responsive design and weighting to control nonresponse bias.Keywords
This publication has 29 references indexed in Scilit:
- Tailored Fieldwork Design to Increase Representative Household Survey Response: An Experiment in the Survey of Consumer SatisfactionJournal of the Royal Statistical Society Series A: Statistics in Society, 2012
- Sensitive Topics and Reluctant Respondents: Demonstrating a Link between Nonresponse Bias and Measurement ErrorPublic Opinion Quarterly, 2010
- Responsive Design for Household Surveys: Tools for Actively Controlling Survey Errors and CostsJournal of the Royal Statistical Society Series A: Statistics in Society, 2006
- Nonresponse Rates and Nonresponse Bias in Household SurveysPublic Opinion Quarterly, 2006
- Experiments in Producing Nonresponse BiasPublic Opinion Quarterly, 2006
- Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone SurveyPublic Opinion Quarterly, 2006
- The Influence of Incremental Increases in Token Cash Incentives on Mail Survey Response: Is There an Optimal Amount?Public Opinion Quarterly, 2004
- Leverage-Saliency Theory of Survey ParticipationPublic Opinion Quarterly, 2000
- Risk behavior and correlates of risk for HIV infection in the Dallas County Household HIV survey.American Journal of Public Health, 1994
- The Problem of Non-Response in Sample SurveysJournal of the American Statistical Association, 1946