Adaptive Identification of Populations with Treatment Benefit in Clinical Trials: Machine Learning Challenges and Solutions
Preprint
Abstract
We study the problem of adaptively identifying patient subpopulations that benefit from a given treatment during a confirmatory clinical trial. This type of adaptive clinical trial has been thoroughly studied in biostatistics, but has been allowed only limited adaptivity so far. Here, we aim to relax classical restrictions on such designs and investigate how to incorporate ideas from the recent machine learning literature on adaptive and online experimentation to make trials more flexible and efficient. We find that the unique characteristics of the subpopulation selection problem -- most importantly that (i) one is usually interested in finding subpopulations with any treatment benefit (and not necessarily the single subgroup with largest effect) given a limited budget and that (ii) effectiveness only has to be demonstrated across the subpopulation on average -- give rise to interesting challenges and new desiderata when designing algorithmic solutions. Building on these findings, we propose AdaGGI and AdaGCPI, two meta-algorithms for subpopulation construction. We empirically investigate their performance across a range of simulation scenarios and derive insights into their (dis)advantages across different settings.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- From Real‐World Patient Data to Individualized Treatment Effects Using Machine Learning: Current and Future Methods to Address Underlying ChallengesClinical Pharmacology & Therapeutics, 2020
- Good arm identification via bandit feedbackMachine Learning, 2019
- Design and estimation in clinical trials with subpopulation selectionStatistics in Medicine, 2018
- Clinical Equipoise and Adaptive Clinical TrialsTopoi, 2018
- Group sequential designs with prospectively planned rules for subpopulation enrichmentStatistics in Medicine, 2016
- A conditional error function approach for subgroup selection in adaptive clinical trialsStatistics in Medicine, 2012
- An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints†Pharmaceutical Statistics, 2010
- Adaptive patient enrichment designs in therapeutic trialsBiometrical Journal, 2009
- Using short‐term response information to facilitate adaptive randomization for survival clinical trialsStatistics in Medicine, 2009
- Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncologyStatistics in Medicine, 2009