Data Quality in PC and Mobile Web Surveys
Top Cited Papers
- 22 April 2013
- journal article
- research article
- Published by SAGE Publications in Social Science Computer Review
- Vol. 31 (6) , 725-743
Abstract
The considerable growth in the number of smart mobile devices with a fast Internet connection provides new challenges for survey researchers. In this article, I compare the data quality between two survey modes: self-administered web surveys conducted via personal computer and those conducted via mobile phones. Data quality is compared based on five indicators: (a) completion rates, (b) response order effects, (c) social desirability, (d) non-substantive responses, and (e) length of open answers. I hypothesized that mobile web surveys would result in lower completion rates, stronger response order effects, and less elaborate answers to open-ended questions. No difference was expected in the level of reporting in sensitive items and in the rate of non-substantive responses. To test the assumptions, an experiment with two survey modes was conducted using a volunteer online access panel in Russia. As expected, mobile web was associated with a lower completion rate, shorter length of open answers, and similar level of socially undesirable and non-substantive responses. However, no stronger primacy effects in mobile web survey mode were found.Keywords
This publication has 24 references indexed in Scilit:
- Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web SurveyPublic Opinion Quarterly, 2009
- Taking the Audio Out of Audio-CASIPublic Opinion Quarterly, 2009
- Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey RespondingPublic Opinion Quarterly, 2008
- Web Survey Methods: IntroductionPublic Opinion Quarterly, 2008
- Computing Response Metrics for Online PanelsPublic Opinion Quarterly, 2008
- An Experimental Comparison of Web and Telephone SurveysPublic Opinion Quarterly, 2005
- What They See Is What We GetSocial Science Computer Review, 2004
- Understanding the Effects of Audio-CASI on Self-Reports of Sensitive BehaviorPublic Opinion Quarterly, 2003
- Web SurveysSocial Science Computer Review, 2001
- A Meta-Analysis of Response Rates in Web- or Internet-Based SurveysEducational and Psychological Measurement, 2000