Using “Broken” Lotteries to Check the Validity of Charter School Evaluations Using Matching Designs
- 21 November 2017
- journal article
- research article
- Published by SAGE Publications in Educational Policy
- Vol. 33 (7) , 977-1001
Abstract
We consider situations in which public charter school lotteries are neither universally conducted nor consistently documented. Such lotteries produce “broken” Randomized Control Trials, but provide opportunities to assess the internal validity of quasi-experimental research designs. Here, we present the results of a statewide charter school evaluation using a broad-based student matching evaluation design, and run two additional analyses using the charter application waitlists as robustness checks. Our additional models, which address concerns of self-selection by using only charter applicants as matched comparison students, yield similar effect estimates and thus provide support for the use of matching designs in charter school evaluations.Keywords
This publication has 10 references indexed in Scilit:
- Can Nonexperimental Estimates Replicate Estimates Based on Random Assignment in Evaluations of School Choice? A Within‐Study ComparisonJournal of Policy Analysis and Management, 2012
- Taking Measure of Charter Schools2010
- Mostly Harmless Econometrics2009
- Charter school quality and parental decision making with school choiceJournal of Public Economics, 2007
- The impact of charter school attendance on student performanceJournal of Public Economics, 2007
- Rhetoric Versus Reality: What We Know and What We Need to Know About Vouchers and Charter Schools2007
- Examining the Impact of Charter Schools on Performance in Traditional Public SchoolsPolicy Studies Journal, 2004
- Principal Stratification Approach to Broken Randomized ExperimentsJournal of the American Statistical Association, 2003
- A Broader Template for Analyzing Broken Randomized ExperimentsSociological Methods & Research, 1998
- A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for HeteroskedasticityEconometrica, 1980