Causal Interaction and External Validity: Obstacles to the Policy Relevance of Randomized Evaluations
- 15 April 2015
- journal article
- research article
- Published by Oxford University Press (OUP) in The World Bank Economic Review
- Vol. 29 (suppl 1) , S217-S225
Abstract
The ability to generalize effects estimated from randomized experiments is critical for their relevance to policy. Framing that problem in terms of causal interaction reveals the extent to which the literature to date has failed to adequately address external validity. An analogy with matching estimators illustrates the current inconsistency in approaches to estimating causal relationships and generalizing these estimates to other populations and contexts. Contrary to some claims, atheoretic replication is not a plausible solution. Better knowledge of, and more information on, interacting factors is required for credible, formal extrapolation. In the absence of that, modesty is recommended.Keywords
This publication has 13 references indexed in Scilit:
- ExtrapoLATE-ing: External Validity and Overidentification in the LATE Framework2013
- Scaling Up What Works: Experimental Evidence on External Validity in Kenyan EducationSSRN Electronic Journal, 2013
- Instruments, Randomization, and Learning about DevelopmentJournal of Economic Literature, 2010
- Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)Journal of Economic Literature, 2010
- Structural vs. atheoretic approaches to econometricsJournal of Econometrics, 2010
- The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con out of EconometricsJournal of Economic Perspectives, 2010
- What are randomised controlled trials good for?Philosophical Studies, 2009
- Nonparametric Tests for Treatment Effect HeterogeneityReview of Economics and Statistics, 2008
- Using Randomization in Development Economics Research: A ToolkitSSRN Electronic Journal, 2006
- Predicting the efficacy of future training programs using past experiences at other locationsJournal of Econometrics, 2005