Balancing vs modeling approaches to weighting in practice
- 3 September 2020
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 39 (24) , 3227-3254
Abstract
There are two seemingly unrelated approaches to weighting in observational studies. One of them maximizes the fit of a model for treatment assignment to then derive weights—we call this the modeling approach. The other directly optimizes certain features of the weights—we call this the balancing approach. The implementations of these two approaches are related: the balancing approach implicitly models the propensity score, while instances of the modeling approach impose balance conditions on the covariates used to estimate the propensity score. In this article, we review and compare these two approaches to weighting. Previous review papers have focused on the modeling approach, emphasizing the importance of checking covariate balance. However, as we discuss, the dispersion of the weights is another important aspect of the weights to consider, in addition to the representativeness of the weighted sample and the sample boundedness of the weighted estimator. In particular, the dispersion of the weights is important because it translates into a measure of effective sample size, which can be used to select between alternative weighting schemes. In this article, we examine the balancing approach to weighting, discuss recent methodological developments, and compare instances of the balancing and modeling approaches in a simulation study and an empirical study. In practice, unless the treatment assignment model is known, we recommend using the balancing approach to weighting, as it systematically results in better covariate balance with weights that are minimally dispersed. As a result, effect estimates tend to be more accurate and stable.Keywords
Funding Information
- Alfred P. Sloan Foundation (G‐2018‐10118)
- National Institutes of Health (1DP2MD012722)
- Patient-Centered Outcomes Research Institute (ME‐2019C1‐16172)
This publication has 54 references indexed in Scilit:
- Diagnosing and responding to violations in the positivity assumptionStatistical Methods in Medical Research, 2010
- Invited Commentary: Positivity in PracticeAmerican Journal of Epidemiology, 2010
- Matching Methods for Causal Inference: A Review and a Look ForwardStatistical Science, 2010
- Improving propensity score weighting using machine learningStatistics in Medicine, 2009
- Constructing Inverse Probability Weights for Marginal Structural ModelsAmerican Journal of Epidemiology, 2008
- Demystifying Double Robustness: A Comparison of Alternative Strategies for Estimating a Population Mean from Incomplete DataStatistical Science, 2007
- Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training ProgramsJournal of the American Statistical Association, 1999
- Estimation of Regression Coefficients When Some Regressors are not Always ObservedJournal of the American Statistical Association, 1994
- Reducing Bias in Observational Studies Using Subclassification on the Propensity ScoreJournal of the American Statistical Association, 1984
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983