Selecting Experimental Sites for External Validity
Preprint
Abstract
Policy decisions often depend on evidence generated elsewhere. We take a Bayesian decision-theoretic approach to choosing where to experiment to optimize external validity. We frame external validity through a policy lens, developing a prior specification for the joint distribution of site-level treatment effects using a microeconometric structural model and allowing for other sources of heterogeneity. With data from South Asia, we show that, relative to basing policies on experiments in optimal sites, large efficiency losses result from instead using evidence from randomly-selected sites or, conversely, from sites with the largest expected treatment effects.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- An Adaptive Targeted Field Experiment: Job Search Assistance for Refugees in JordanJournal of the European Economic Association, 2023
- Generalizing the Results from Social Experiments: Theory and Evidence from IndiaJournal of Business & Economic Statistics, 2023
- Experimental evidence on learning using low-tech when school is outNature Human Behaviour, 2022
- Narrowing the gender gap in mobile bankingJournal of Economic Behavior & Organization, 2022
- How Much Can We Generalize From Impact Evaluations?Journal of the European Economic Association, 2020
- From Local to Global: External Validity in a Fertility Natural ExperimentJournal of Business & Economic Statistics, 2019
- Short-term Migration, Rural Public Works, and Urban Labor Markets: Evidence from IndiaJournal of the European Economic Association, 2019
- Understanding and misunderstanding randomized controlled trialsSocial Science & Medicine, 2018
- Site Selection Bias in Program Evaluation *The Quarterly Journal of Economics, 2015
- Predicting the efficacy of future training programs using past experiences at other locationsJournal of Econometrics, 2005