Estimating Causal Effects of Education Interventions Using a Two-Rating Regression Discontinuity Design: Lessons From a Simulation Study and an Application
- 25 August 2016
- journal article
- research article
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 10 (1) , 138-167
Abstract
A valuable extension of the single-rating regression discontinuity design (RDD) is a multiple-rating RDD (MRRDD). To date, four main methods have been used to estimate average treatment effects at the multiple treatment frontiers of an MRRDD: the “surface” method, the “frontier” method, the “binding-score” method, and the “fuzzy instrumental variables” method. This article uses a series of simulations to evaluate the relative performance of each of these four methods under a variety of different data-generating models. Focusing on a two-rating RDD (2RRDD), we compare the methods in terms of their bias, precision, and mean squared error when implemented as they most likely would be in practice—using optimal bandwidth selection. We also apply the lessons learned from the simulations to a real-world example that uses data from a study of an English learner reclassification policy. Overall, this article makes valuable contributions to the literature on MRRDDs in that it makes concrete recommendations for choosing among MRRDD estimation methods, for implementing any chosen method using local linear regression, and for providing accurate statistical inferences.Keywords
Funding Information
- Institute of Education Sciences (R305D100027)
This publication has 19 references indexed in Scilit:
- Regression Discontinuity Designs With Multiple Rating-Score VariablesJournal of Research on Educational Effectiveness, 2012
- Modern Regression Discontinuity AnalysisJournal of Research on Educational Effectiveness, 2012
- Extending the regression-discontinuity approach to multiple assignment variablesJournal of Econometrics, 2011
- Effects of Failing a High School Exit Exam on Course Taking, Achievement, Persistence, and GraduationEducational Evaluation and Policy Analysis, 2010
- The Consequences of High School Exit Examinations for Low-Performing Urban Students: Evidence From MassachusettsEducational Evaluation and Policy Analysis, 2010
- Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within‐study comparisonsJournal of Policy Analysis and Management, 2008
- Mandatory summer school and student achievementJournal of Econometrics, 2008
- Special issue editors’ introduction: The regression discontinuity design—Theory and applicationsJournal of Econometrics, 2008
- Randomized experiments from non-random selection in U.S. House electionsJournal of Econometrics, 2008
- Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity DesignThe Quarterly Journal of Economics, 2007