Can Propensity-Score Methods Match the Findings from a Random Assignment Evaluation of Mandatory Welfare-to-Work Programs?
Authors:
- Charles MichalopoulosCMCharles Michalopoulos
- Howard S. BloomHBHoward S. Bloom
- Carolyn J. HillCHCarolyn J. Hill
- 1 February 2004
- journal article
- Published by MIT Press in Review of Economics and Statistics
- Vol. 86 (1) , 156-179
Abstract
This paper assesses nonexperimental estimators using results from a six-state random assignment study of mandatory welfare-to-work programs. The assessment addresses two questions: which nonexperimental methods provide the most accurate estimates; and do the best methods work well enough to replace random assignment? Three tentative conclusions emerge. Nonexperimental bias was larger in the medium run than in the short run. In-state comparison groups produced less average bias than out-of-State comparison groups. Statistical adjustments did not consistently reduce bias, although some methods reduced the estimated bias in some circumstances and propensity-score methods provided a specification check that eliminated some large biases.Keywords
This publication has 8 references indexed in Scilit:
- Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training ProgramsJournal of the American Statistical Association, 1999
- The Pre‐programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation StrategiesThe Economic Journal, 1999
- Characterizing Selection Bias Using Experimental DataEconometrica, 1998
- Matching As An Econometric Evaluation EstimatorReview of Economic Studies, 1998
- Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training ProgrammeReview of Economic Studies, 1997
- Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower TrainingJournal of the American Statistical Association, 1989
- The Adequacy of Comparison Group Designs for Evaluations of Employment-Related ProgramsThe Journal of Human Resources, 1987
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983