Applying Multiple Imputation to Improve Estimates from Web Surveys: An Alternative to the Pseudoweighting Method
Authors:
Open Access
- 4 August 2026
- journal article
- research article
- Published by SAGE Publications in Journal of Official Statistics
- Vol. 42 (3) , 414-445
Abstract
To improve the timeliness of data products, survey researchers and practitioners have increasingly used web surveys and alike to collect information for population health research and dissemination. From the statistical inferential perspective, these data are often referred to as nonprobability samples due to the lack of a well-defined probability sampling structure, or they come from probability panel surveys yet are subject to high nonresponse and/or coverage errors. Certain statistical adjustments are therefore needed to make proper inferences using web surveys. With a high-quality reference probability survey available, one popular adjustment approach is to create pseudoweights that properly “weight” the web survey samples back to the target population underlying the reference survey in order to produce population-weighted estimates of the target of interest. When the variable of interest is collected in the web survey but not in the reference survey, the analytical question can also be framed as a missing data problem. Thus we propose to multiply impute the missing variable on the reference survey which combines the information from both data sources. We illustrate main features and performances of the multiple imputation strategy using a simulation study. The simulation results have shown that the multiple imputation analysis method is comparable to the pseudoweighting method, both of which can adequately account for the nonprobability feature of web surveys to improve the statistical inference. We also present a real data analysis based on the web-based Research and Development Survey and the interviewer-administered National Health Interview Survey. Our research shows that results from different imputation and pseudoweighting models can be compared to better understand features of the web survey data and improve the analysis.Keywords
This publication has 39 references indexed in Scilit:
- Adjusted logistic propensity weighting methods for population inference using nonprobabilityvolunteer‐basedepidemiologic cohortsStatistics in Medicine, 2021
- A multiple imputation‐based sensitivity analysis approach for data subject to missing not at randomStatistics in Medicine, 2020
- Combining information from two data sources with misreporting and incompleteness to assess hospice‐use among cancer patients: a multiple imputation approachStatistics in Medicine, 2014
- Improving on analyses of self‐reported data in a large‐scale health survey by using information from an examination‐based surveyStatistics in Medicine, 2010
- Inference under Informative Sampling2009
- On weighting the rates in non‐response weightsStatistics in Medicine, 2003
- Analysis of Health Surveys1999
- A multiple imputation strategy for clinical trials with truncation of patient dataStatistics in Medicine, 1995
- Multiple Imputation for Nonresponse in Surveys1987
- Density Estimation for Statistics and Data Analysis1986