Propensity Score Matching with Cross-Classified Data Structures: A Comparison of Methods
- 20 January 2023
- journal article
- research article
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 92 (2) , 359-376
Abstract
In the current study, we compare propensity score (PS) matching methods for data with a cross-classified structure, where each individual is clustered within more than one group, but the groups are not hierarchically organized. Through a Monte Carlo simulation study, we compared sequential cluster matching (SCM), preferential within cluster matching (PWCM), greedy matching (GM), and optimal full matching (OFM), using propensity scores from four different models. The results indicated that the four matching methods performed well when PSs were estimated with logistic regression containing both level-1 and level-2 covariates. When the level-2 covariates were omitted in the logistic regression PS model, matching methods resulted in biased treatment effect estimates. However, omission of level-2 covariates did not result in biased estimates when the PS model was a logistic cross-classified random effects model (CCREM). SCM and PWCM outperformed GM and OFM with a logistic CCREM that included level-1 and level-2 covariates.Keywords
All Related Versions
This publication has 56 references indexed in Scilit:
- An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational StudiesMultivariate Behavioral Research, 2011
- Comparing paired vs non‐paired statistical methods of analyses when making inferences about absolute risk reductions in propensity‐score matched samplesStatistics in Medicine, 2011
- Matching Methods for Causal Inference: A Review and a Look ForwardStatistical Science, 2010
- An Examination of the Precision and Technical Accuracy of the First Wave of Group-Randomized Trials Funded by the Institute of Education SciencesEducational Evaluation and Policy Analysis, 2009
- Intraclass Correlation Values for Planning Group-Randomized Trials in EducationEducational Evaluation and Policy Analysis, 2007
- Optimal Full Matching and Related Designs via Network FlowsJournal of Computational and Graphical Statistics, 2006
- Experimental and Quasi‐Experimental Designs for Generalized Causal Inference, by William R. Shadish, Thomas D. Cook, and Donald T. Campbell. Boston: Houghton Mifflin, 2001, 623 pp., $65.56.Journal of Policy Analysis and Management, 2003
- Optimal Matching for Observational StudiesJournal of the American Statistical Association, 1989
- Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity ScoreThe American Statistician, 1985
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983