Comparing internet and face-to-face surveys as methods for eliciting preferences for social care-related quality of life: evidence from England using the ASCOT service user measure
Open Access
- 3 April 2019
- journal article
- research article
- Published by Springer Nature in Quality of Life Research
- Vol. 28 (8) , 2207-2220
Abstract
Purpose Traditionally, researchers have relied on eliciting preferences through face-to-face interviews. Recently, there has been a shift towards using internet-based methods. Different methods of data collection may be a source of variation in the results. In this study, we compare the preferences for the Adult Social Care Outcomes Toolkit (ASCOT) service user measure elicited using best–worst scaling (BWS) via a face-to-face interview and an online survey. Methods Data were collected from a representative sample of the general population in England. The respondents (face-to-face: n = 500; online: n = 1001) completed a survey, which included the BWS experiment involving the ASCOT measure. Each respondent received eight best–worst scenarios and made four choices (best, second best, worst, second worst) in each scenario. Multinomial logit regressions were undertaken to analyse the data taking into account differences in the characteristics of the two samples and the repeated nature of the data. Results We initially found a number of small significant differences in preferences between the two methods across all ASCOT domains. These differences were substantially reduced—from 15 to 5 out of 30 coefficients being different at the 5% level—and remained small in value after controlling for differences in observable and unobservable characteristics of the two samples. Conclusions This comparison demonstrates that face-to-face and internet surveys may lead to fairly similar preferences for social care-related quality of life when differences in sample characteristics are controlled for. With or without a constant sampling frame, studies should carefully design the BWS exercise and provide similar levels of clarification to participants in each survey to minimise the amount of error variance in the choice process.Keywords
Funding Information
- Norface (462-14-160)
- Austrian Science Fund
- Vienna Social Fund (I 2252-G16)
- National Institute for Health and Welfare, Finland
This publication has 27 references indexed in Scilit:
- Impact of Survey Administration Mode on the Results of a Health-Related Discrete Choice Experiment: Online and Paper ComparisonValue in Health, 2017
- Discrete Choice Experiments in Health Economics: A Review of the LiteraturePharmacoEconomics, 2014
- Binary Choice Health State Valuation and Mode of Administration: Head-to-Head Comparison of Online and CAPIValue in Health, 2013
- Using Internet in Stated Preference Surveys: A Review and Comparison of Survey ModesInternational Review of Environmental and Resource Economics, 2011
- Comparing Responses from Internet and Paper-Based Collection Methods in more Complex Stated Preference Environmental Valuation SurveysEconomic Analysis and Policy, 2011
- Assessing the Effect of Data Collection Mode on MeasurementInternational Statistical Review, 2010
- Responsibility, scale and the valuation of rail safetyJournal of Risk and Uncertainty, 2009
- Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market GoodsEnvironmental and Resource Economics, 2009
- Why Choice of Survey Mode Makes a DifferencePublic Health Reports®, 2006
- Mode of questionnaire administration can have serious effects on data qualityJournal of Public Health, 2005