Adaptive experiments toward learning treatment effect heterogeneity
- 24 February 2025
- journal article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 87 (4) , 1055-1084
Abstract
Understanding treatment effect heterogeneity has become an increasingly popular task in various fields, as it helps design personalized advertisements in e-commerce or targeted treatment in biomedical studies. However, most of the existing work in this research area focused on either analysing observational data based on strong causal assumptions or conducting post hoc analyses of randomized controlled trial data, and there has been limited effort dedicated to the design of randomized experiments specifically for uncovering treatment effect heterogeneity. In the manuscript, we develop a framework for designing and analysing response adaptive experiments toward better learning treatment effect heterogeneity. Concretely, we provide response adaptive experimental design frameworks that sequentially revise the data collection mechanism according to the accrued evidence during the experiment. Such design strategies allow for the identification of subgroups with the largest treatment effects with enhanced statistical efficiency. The proposed frameworks not only unify adaptive enrichment designs and response-adaptive randomization designs but also complement A/B test designs in e-commerce and randomized trial designs in clinical settings. We demonstrate the merit of our design with theoretical justifications and in simulation studies with synthetic e-commerce and clinical trial data.Keywords
All Related Versions
Funding Information
- NSF CAREER (DMS-2239047)
- NSF (DMS-2220537)
This publication has 77 references indexed in Scilit:
- A two‐stage group‐sequential design for delayed treatment responses with the possibility of trial restartStatistics in Medicine, 2024
- The pursuit of balance: An overview of covariate-adaptive randomization techniques in clinical trialsContemporary Clinical Trials, 2015
- Concentration Inequalities for Sums and Martingales2015
- Subgroup-Based Adaptive (SUBA) Designs for Multi-arm Biomarker TrialsStatistics in Biosciences, 2014
- Outcome-adaptive randomization for a delayed outcome with a short-term predictor: imputation-based designsStatistics in Medicine, 2014
- The Theory of Response‐Adaptive Randomization in Clinical Trials2006
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- The doubly adaptive biased coin design for sequential clinical trialsJournal of Statistical Planning and Inference, 1994
- The use of response-adaptive designs in clinical trialsControlled Clinical Trials, 1993
- The randomization and stratification of patients to clinical trialsJournal of Chronic Diseases, 1974