Evaluating Relative Mode Effects in Mixed-Mode Surveys:
- 13 November 2012
- journal article
- Published by SAGE Publications in Sociological Methods & Research
- Vol. 42 (1) , 82-104
Abstract
In order to investigate the advantage of mixed-mode (MM) surveys, selection effects between the modes should be evaluated. Selection effects refer to differences in respondent compositions on the target variables between the modes. However, estimation of selection effects is not an easy task because they may be completely confounded with measurement effects between the modes (differences in measurement error). Publications concerning the estimation of these mode effects are scarce. This article presents and compares three methods that allow measurement effects and selection effects to be evaluated separately. The first method starts from existing publications that avoid the confounding problem by introducing a set of mode-insensitive variables into the analysis model. However, this article will show that this method involves unrealistic assumptions in most practical research. The second and the third methods make use of an MM sample extended by comparable single-mode data. The assumptions, advantages, and disadvantages of all three methods are discussed. Each method will further be illustrated using a set of six variables relating to opinions about surveys among the Flemish population. The results show large differences between the methods.Keywords
This publication has 26 references indexed in Scilit:
- Assessing the Effect of Data Collection Mode on MeasurementInternational Statistical Review, 2010
- The Mode Effect in Mixed-Mode SurveysSocial Science Computer Review, 2009
- Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the InternetSocial Science Research, 2009
- The Possibility of Mixed‐Mode Surveys in Sociological StudiesInternational Journal of Japanese Sociology, 2007
- An Experimental Comparison of Web and Telephone SurveysPublic Opinion Quarterly, 2005
- Telephone versus Face-to-Face Interviewing of National Probability Samples with Long QuestionnairesPublic Opinion Quarterly, 2003
- Effects of telephone versus face‐to‐face interview modes on reports of alcohol consumptionAddiction, 2000
- The Problems of Researching Sensitive TopicsAmerican Behavioral Scientist, 1990
- Causal Inference, Path Analysis, and Recursive Structural Equations ModelsSociological Methodology, 1988
- Surveys on Surveys: Limitations and PotentialitiesPublic Opinion Quarterly, 1986