Estimating Heterogeneous Treatment Effects and the Effects of Heterogeneous Treatments with Ensemble Methods
Authors:
- 1 January 2017
- journal article
- research article
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 25 (4) , 413-434
Abstract
Randomized experiments are increasingly used to study political phenomena because they can credibly estimate the average effect of a treatment on a population of interest. But political scientists are often interested in how effects vary across subpopulations—heterogeneous treatment effects—and how differences in the content of the treatment affects responses—the response to heterogeneous treatments. Several new methods have been introduced to estimate heterogeneous effects, but it is difficult to know if a method will perform well for a particular data set. Rather than using only one method, we show how an ensemble of methods—weighted averages of estimates from individual models increasingly used in machine learning—accurately measure heterogeneous effects. Building on a large literature on ensemble methods, we show how the weighting of methods can contribute to accurate estimation of heterogeneous treatment effects and demonstrate how pooling models lead to superior performance to individual methods across diverse problems. We apply the ensemble method to two experiments, illuminating how the ensemble method for heterogeneous treatment effects facilitates exploratory analysis of treatment effects.Keywords
This publication has 30 references indexed in Scilit:
- How Words and Money Cultivate a Personal Vote: The Effect of Legislator Credit Claiming on Constituent Credit AllocationAmerican Political Science Review, 2012
- Modeling Heterogeneous Treatment Effects in Survey Experiments with Bayesian Additive Regression TreesPublic Opinion Quarterly, 2012
- Why We (Usually) Don't Have to Worry About Multiple ComparisonsJournal of Research on Educational Effectiveness, 2012
- Bootstrapping Lasso EstimatorsJournal of the American Statistical Association, 2011
- Estimation of Heterogeneous Treatment Effects from Randomized Experiments, with Application to the Optimal Planning of the Get-Out-the-Vote CampaignPolitical Analysis, 2011
- Computer-Assisted Topic Classification for Mixed-Methods Social Science ResearchJournal of Information Technology & Politics, 2008
- Super LearnerStatistical Applications in Genetics and Molecular Biology, 2007
- Improvements to Platt's SMO Algorithm for SVM Classifier DesignNeural Computation, 2001
- Making the Most of Statistical Analyses: Improving Interpretation and PresentationAmerican Journal of Political Science, 2000
- Statistics and Causal InferenceJournal of the American Statistical Association, 1986