[Invited Discussion] Randomization Tests to Address Disruptions in Clinical Trials: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions
Preprint
Abstract
Disruptions in clinical trials may be due to external events like pandemics, warfare, and natural disasters. Resulting complications may lead to unforeseen intercurrent events (events that occur after treatment initiation and affect the interpretation of the clinical question of interest or the existence of the measurements associated with it). In Uschner et al. (2023), several example clinical trial disruptions are described: treatment effect drift, population shift, change of care, change of data collection, and change of availability of study medication. A complex randomized controlled trial (RCT) setting with (planned or unplanned) intercurrent events is then described, and randomization tests are presented as a means for non-parametric inference that is robust to violations of assumption typically made in clinical trials. While estimation methods like Targeted Learning (TL) are valid in such settings, we do not see where the authors make the case that one should be going for a randomization test in such disrupted RCTs. In this discussion, we comment on the appropriateness of TL and the accompanying TL Roadmap in the context of disrupted clinical trials. We highlight a few key articles related to the broad applicability of TL for RCTs and real-world data (RWD) analyses with intercurrent events. We begin by introducing TL and motivating its utility in Section 2, and then in Section 3 we provide a brief overview of the TL Roadmap. In Section 4 we recite the example clinical trial disruptions presented in Uschner et al. (2023), discussing considerations and solutions based on the principles of TL. We request in an authors' rejoinder a clear theoretical demonstration with specific examples in this setting that a randomization test is the only valid inferential method relative to one based on following the TL Roadmap.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Targeted Learning: Toward a Future Informed by Real-World EvidenceStatistics in Biopharmaceutical Research, 2023
- Practical considerations for specifying a super learnerInternational Journal of Epidemiology, 2023
- Efficient and Robust Approaches for Analysis of Sequential Multiple Assignment Randomized Trials: Illustration Using the ADAPT-R TrialBiometrics, 2022
- Developing a Targeted Learning-Based Statistical Analysis PlanStatistics in Biopharmaceutical Research, 2022
- Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial DisruptionsStatistics in Biopharmaceutical Research, 2022
- Data-Adaptive Selection of the Propensity Score Truncation Level for Inverse-Probability–Weighted and Targeted Maximum Likelihood Estimators of Marginal Point Treatment EffectsAmerican Journal of Epidemiology, 2022
- The Current Landscape in Biostatistics of Real-World Data and Evidence: Causal Inference Frameworks for Study Design and AnalysisStatistics in Biopharmaceutical Research, 2021
- Discussion of “Randomization: The forgotten component of the randomized clinical trial”Statistics in Medicine, 2018
- Implementation of G-Computation on a Simulated Data Set: Demonstration of a Causal Inference TechniqueAmerican Journal of Epidemiology, 2011
- A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effectMathematical Modelling, 1986