It’s all about balance: propensity score matching in the context of complex survey data
Authors:
- 27 December 2017
- journal article
- research article
- Published by Oxford University Press (OUP) in Biostatistics
- Vol. 20 (1) , 147-163
Abstract
Many research studies aim to draw causal inferences using data from large, nationally representative survey samples, and many of these studies use propensity score matching to make those causal inferences as rigorous as possible given the non-experimental nature of the data. However, very few applied studies are careful about incorporating the survey design with the propensity score analysis, which may mean that the results do not generate population inferences. This may be because few methodological studies examine how to best combine these methods. Furthermore, even fewer of them investigate different non-response mechanisms. This study examines methods for handling survey weights in propensity score matching analyses of survey data under different non-response mechanisms. Our main conclusions are: (i) whether the survey weights are incorporated in the estimation of the propensity score does not impact estimation of the population treatment effect, as long as good population treated-comparison balance is achieved on confounders, (ii) survey weights must be used in the outcome analysis, and (iii) the transferring of survey weights (i.e., assigning the weights of the treated units to the comparison units matched to them) can be beneficial under certain non-response mechanisms.Keywords
Funding Information
- National Institute of Mental Health (R01MH099010)
- US Institute of Education Sciences (R305D150001)
This publication has 36 references indexed in Scilit:
- Combining Multiple Imputation and Inverse‐Probability WeightingBiometrics, 2011
- Weight Trimming and Propensity Score WeightingPLOS ONE, 2011
- A note on adapting propensity score matching and selection models to choice based samplesThe Econometrics Journal, 2009
- A Propensity Score Matching Analysis of the Effects of Special Education ServicesThe Journal of Special Education, 2008
- Nonexperimental Versus Experimental Estimates of Earnings ImpactsThe Annals of the American Academy of Political and Social Science, 2003
- Combining Propensity Score Matching with Additional Adjustments for Prognostic CovariatesJournal of the American Statistical Association, 2000
- The Analysis of Social Science Data with Missing ValuesSociological Methods & Research, 1989
- Reducing Bias in Observational Studies Using Subclassification on the Propensity ScoreJournal of the American Statistical Association, 1984
- An Evaluation of Model-Dependent and Probability-Sampling Inferences in Sample SurveysJournal of the American Statistical Association, 1983
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983