Supplementing Small Probability Samples with Nonprobability Samples: A Bayesian Approach
Open Access
- 1 September 2019
- journal article
- research article
- Published by SAGE Publications in Journal of Official Statistics
- Vol. 35 (3) , 653-681
Abstract
Carefully designed probability-based sample surveys can be prohibitively expensive to conduct. As such, many survey organizations have shifted away from using expensive probability samples in favor of less expensive, but possibly less accurate, nonprobability web samples. However, their lower costs and abundant availability make them a potentially useful supplement to traditional probability-based samples. We examine this notion by proposing a method of supplementing small probability samples with nonprobability samples using Bayesian inference. We consider two semi-conjugate informative prior distributions for linear regression coefficients based on nonprobability samples, one accounting for the distance between maximum likelihood coefficients derived from parallel probability and non-probability samples, and the second depending on the variability and size of the nonprobability sample. The method is evaluated in comparison with a reference prior through simulations and a real-data application involving multiple probability and nonprobability surveys fielded simultaneously using the same questionnaire. We show that the method reduces the variance and mean-squared error (MSE) of coefficient estimates and model-based predictions relative to probability-only samples. Using actual and assumed cost data we also show that the method can yield substantial cost savings (up to 55%) for a fixed MSE.Keywords
This publication has 30 references indexed in Scilit:
- Does the Recruitment of Offline Households Increase the Sample Representativeness of Probability-Based Online Panels? Evidence From the German Internet PanelSocial Science Computer Review, 2016
- A Comparison of Four Probability-Based Online and Mixed-Mode Panels in EuropeSocial Science Computer Review, 2015
- Setting Up an Online Panel Representative of the General PopulationField Methods, 2015
- Online Panel Research2014
- Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode ComparisonPolitical Analysis, 2014
- Cooperative Survey ResearchAnnual Review of Political Science, 2013
- National Surveys Via Rdd Telephone Interviewing Versus the InternetPublic Opinion Quarterly, 2009
- Census Data Issues for Epidemiology and Health Risk Assessment: Experiences from the Small Area Health Statistics UnitJournal of the Royal Statistical Society Series A: Statistics in Society, 2007
- Personality Structure: Emergence of the Five-Factor ModelAnnual Review of Psychology, 1990
- The need for cognition.Journal of Personality and Social Psychology, 1982