Adaptive Experiments Toward Learning Treatment Effect Heterogeneity
Authors:
Preprint
Abstract
Understanding treatment effect heterogeneity has become an increasingly popular task in various fields, as it helps design personalized advertisements in e-commerce or targeted treatment in biomedical studies. However, most of the existing work in this research area focused on either analyzing observational data based on strong causal assumptions or conducting post hoc analyses of randomized controlled trial data, and there has been limited effort dedicated to the design of randomized experiments specifically for uncovering treatment effect heterogeneity. In the manuscript, we develop a framework for designing and analyzing response adaptive experiments toward better learning treatment effect heterogeneity. Concretely, we provide response adaptive experimental design frameworks that sequentially revise the data collection mechanism according to the accrued evidence during the experiment. Such design strategies allow for the identification of subgroups with the largest treatment effects with enhanced statistical efficiency. The proposed frameworks not only unify adaptive enrichment designs and response-adaptive randomization designs but also complement A/B test designs in e-commerce and randomized trial designs in clinical settings. We demonstrate the merit of our design with theoretical justifications and in simulation studies with synthetic e-commerce and clinical trial data.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Inference on the best policies with many covariatesJournal of Econometrics, 2023
- Incorporating covariates information in adaptive clinical trials for precision medicinePharmaceutical Statistics, 2021
- Adaptive enrichment designs for confirmatory trialsStatistics in Medicine, 2018
- The pursuit of balance: An overview of covariate-adaptive randomization techniques in clinical trialsContemporary Clinical Trials, 2015
- The affective and interpersonal consequences of obesityOrganizational Behavior and Human Decision Processes, 2015
- Subgroup-Based Adaptive (SUBA) Designs for Multi-arm Biomarker TrialsStatistics in Biosciences, 2014
- A practical guide to Bayesian group sequential designsPharmaceutical Statistics, 2013
- Estimation following selection of the largest of two normal meansJournal of Statistical Planning and Inference, 2008
- The Theory of Response‐Adaptive Randomization in Clinical Trials2006
- A Modern Theory of Factorial Designs2006