Babak Choodari-Oskooei
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Babak Choodari-Oskooei has a total of 88 co-authors. Here are the top co-authors by number of shared publications:
- David S. Robertson
University of Cambridge
7 shared publications - Philip Pallmann
Centre for Trials Research, School of Medicine, Cardiff University
7 shared publications - Matthew Robert Sydes
Medical Research Council Clinical Trials Unit at UCL, London, UK
6 shared publications Mahesh K. B. Parmar
MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, UCL, London, UK
4 shared publications- Munyaradzi Dimairo
Division of Population Health, Sheffield Centre for Health and Related Research, University of Sheffield, Sheffield, UK
4 shared publications - Thomas Jaki
MRC Biostatistics Unit, University of Cambridge, Cambridge, UK
4 shared publications
Latest Publications
- Open Access
- 16 March 2026
- Published by Wiley in Statistics in Medicine
- Vol. 45 (6-7) , e70449
Clinical Trial Simulation: Planning With the OCTAVE Framework, Implementation and Validation Principles
The adoption of complex innovative clinical trial designs has steadily increased in recent years. These are trial designs that have one or more unconventional features—often resulting in multiple stages—with the goal of improving on conventional single‐stage, fixed‐setting designs in terms of efficiency, for example, by reducing the required sample size or the time to establish findings about an intervention. The motivation for these designs may not be difficult to follow, but their set‐up and implementation is usually more challenging. Statistical properties of these designs can also be difficult to compute. Clinical trial simulation (CTS), which uses software to generate artificial data for learning, can be conducted to identify the (optimal) setting of a clinical trial, evaluate the design's statistical properties under some hypothetical scenarios for sensitivity analysis, and compare different design set‐ups and data analysis strategies, all of which contribute to a better understanding of the value of unconventional features before implementing the design in an actual clinical trial. Existing literature on simulation primarily focuses on the evaluation of statistical analysis methods, with less attention on the detailed specification and planning of CTS. This tutorial presents a new framework, called OCTAVE, for outlining the details of CTS, provides practical recommendations for their implementation, and addresses key computational considerations. The target audience is trial statisticians who are involved in designing and analyzing clinical trials. This tutorial covers a range of complex innovative designs, without the expectation that readers are familiar with the mentioned examples.
- 16 March 2026
- Published by Wiley in Statistics in Medicine
- Vol. 45 (6-7) , e70449
Open AccessClinical Trial Simulation: Planning With the OCTAVE Framework, Implementation and Validation Principles
The adoption of complex innovative clinical trial designs has steadily increased in recent years. These are trial designs that have one or more unconventional features—often resulting in multiple stages—with the goal of improving on conventional single‐stage, fixed‐setting designs in terms of efficiency, for example, by reducing the required sample size or the time to establish findings about an intervention. The motivation for these designs may not be difficult to follow, but their set‐up and implementation is usually more challenging. Statistical properties of these designs can also be difficult to compute. Clinical trial simulation (CTS), which uses software to generate artificial data for learning, can be conducted to identify the (optimal) setting of a clinical trial, evaluate the design's statistical properties under some hypothetical scenarios for sensitivity analysis, and compare different design set‐ups and data analysis strategies, all of which contribute to a better understanding of the value of unconventional features before implementing the design in an actual clinical trial. Existing literature on simulation primarily focuses on the evaluation of statistical analysis methods, with less attention on the detailed specification and planning of CTS. This tutorial presents a new framework, called OCTAVE, for outlining the details of CTS, provides practical recommendations for their implementation, and addresses key computational considerations. The target audience is trial statisticians who are involved in designing and analyzing clinical trials. This tutorial covers a range of complex innovative designs, without the expectation that readers are familiar with the mentioned examples.
- Open Access
- 8 August 2025
- Published by Wiley in Statistics in Medicine
- Vol. 44 (18-19) , e70202
Confidence Intervals for Adaptive Trial Designs II : Case Study and Practical Guidance
In adaptive clinical trials, the conventional confidence interval (CI) for a treatment effect is prone to undesirable properties such as undercoverage and potential inconsistency with the final hypothesis testing decision. Accordingly, as is stated in recent regulatory guidance on adaptive designs, there is the need for caution in the interpretation of CIs constructed during and after an adaptive clinical trial. However, it may be unclear which of the available CIs in the literature are preferable. This paper is the second in a two‐part series that explores CIs for adaptive trials. Part I provided a methodological review of approaches to construct CIs for adaptive designs. In this paper (Part II), we present an extended case study based around a two‐stage group sequential trial, including a comprehensive simulation study of the proposed CIs for this setting. This facilitates an expanded description of considerations around what makes for an effective CI procedure following an adaptive trial. We show that the CIs can have notably different properties. Finally, we propose a set of guidelines for researchers around the choice of CIs and the reporting of CIs following an adaptive design.
- 8 August 2025
- Published by Wiley in Statistics in Medicine
- Vol. 44 (18-19) , e70202
Open AccessConfidence Intervals for Adaptive Trial Designs II : Case Study and Practical Guidance
In adaptive clinical trials, the conventional confidence interval (CI) for a treatment effect is prone to undesirable properties such as undercoverage and potential inconsistency with the final hypothesis testing decision. Accordingly, as is stated in recent regulatory guidance on adaptive designs, there is the need for caution in the interpretation of CIs constructed during and after an adaptive clinical trial. However, it may be unclear which of the available CIs in the literature are preferable. This paper is the second in a two‐part series that explores CIs for adaptive trials. Part I provided a methodological review of approaches to construct CIs for adaptive designs. In this paper (Part II), we present an extended case study based around a two‐stage group sequential trial, including a comprehensive simulation study of the proposed CIs for this setting. This facilitates an expanded description of considerations around what makes for an effective CI procedure following an adaptive trial. We show that the CIs can have notably different properties. Finally, we propose a set of guidelines for researchers around the choice of CIs and the reporting of CIs following an adaptive design.
- Open Access
- 8 August 2025
- Published by Wiley in Statistics in Medicine
- Vol. 44 (18-19) , e70174
Confidence Intervals for Adaptive Trial Designs I: A Methodological Review
Regulatory guidance notes the need for caution in the interpretation of confidence intervals (CIs) constructed during and after an adaptive clinical trial. Conventional CIs of the treatment effects are prone to undercoverage (as well as other undesirable properties) in many adaptive designs (ADs) because they do not take into account the potential and realized trial adaptations. This paper is the first in a two‐part series that explores CIs for adaptive trials. It provides a comprehensive review of the methods to construct CIs for ADs, while the second paper illustrates how to implement these in practice and proposes a set of guidelines for trial statisticians. We describe several classes of techniques for constructing CIs for adaptive clinical trials before providing a systematic literature review of available methods, classified by the type of AD. As part of this, we assess, through a proposed traffic light system, which of several desirable features of CIs (such as achieving nominal coverage and consistency with the hypothesis test decision) each of these methods holds.
- 8 August 2025
- Published by Wiley in Statistics in Medicine
- Vol. 44 (18-19) , e70174
Open AccessConfidence Intervals for Adaptive Trial Designs I: A Methodological Review
Regulatory guidance notes the need for caution in the interpretation of confidence intervals (CIs) constructed during and after an adaptive clinical trial. Conventional CIs of the treatment effects are prone to undercoverage (as well as other undesirable properties) in many adaptive designs (ADs) because they do not take into account the potential and realized trial adaptations. This paper is the first in a two‐part series that explores CIs for adaptive trials. It provides a comprehensive review of the methods to construct CIs for ADs, while the second paper illustrates how to implement these in practice and proposes a set of guidelines for trial statisticians. We describe several classes of techniques for constructing CIs for adaptive clinical trials before providing a systematic literature review of available methods, classified by the type of AD. As part of this, we assess, through a proposed traffic light system, which of several desirable features of CIs (such as achieving nominal coverage and consistency with the hypothesis test decision) each of these methods holds.
- Open Access
- 2 July 2024
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 24 (1) , 1-2
Correction: Multi‑arm multi‑stage (MAMS) randomised selection designs: impact of treatment selection rules on the operating characteristics
- 2 July 2024
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 24 (1) , 1-2
Open AccessCorrection: Multi‑arm multi‑stage (MAMS) randomised selection designs: impact of treatment selection rules on the operating characteristics
- Open Access
- 3 June 2024
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 24 (1) , 1-12
Multi-arm multi-stage (MAMS) randomised selection designs: impact of treatment selection rules on the operating characteristics
Background: Multi-arm multi-stage (MAMS) randomised trial designs have been proposed to evaluate multiple research questions in the confirmatory setting. In designs with several interventions, such as the 8-arm 3-stage ROSSINI-2 trial for preventing surgical wound infection, there are likely to be strict limits on the number of individuals that can be recruited or the funds available to support the protocol. These limitations may mean that not all research treatments can continue to accrue the required sample size for the definitive analysis of the primary outcome measure at the final stage. In these cases, an additional treatment selection rule can be applied at the early stages of the trial to restrict the maximum number of research arms that can progress to the subsequent stage(s). This article provides guidelines on how to implement treatment selection within the MAMS framework. It explores the impact of treatment selection rules, interim lack-of-benefit stopping boundaries and the timing of treatment selection on the operating characteristics of the MAMS selection design. Methods: We outline the steps to design a MAMS selection trial. Extensive simulation studies are used to explore the maximum/expected sample sizes, familywise type I error rate (FWER), and overall power of the design under both binding and non-binding interim stopping boundaries for lack-of-benefit. Results: Pre-specification of a treatment selection rule reduces the maximum sample size by approximately 25% in our simulations. The familywise type I error rate of a MAMS selection design is smaller than that of the standard MAMS design with similar design specifications without the additional treatment selection rule. In designs with strict selection rules - for example, when only one research arm is selected from 7 arms - the final stage significance levels can be relaxed for the primary analyses to ensure that the overall type I error for the trial is not underspent. When conducting treatment selection from several treatment arms, it is important to select a large enough subset of research arms (that is, more than one research arm) at early stages to maintain the overall power at the pre-specified level. Conclusions: Multi-arm multi-stage selection designs gain efficiency over the standard MAMS design by reducing the overall sample size. Diligent pre-specification of the treatment selection rule, final stage significance level and interim stopping boundaries for lack-of-benefit are key to controlling the operating characteristics of a MAMS selection design. We provide guidance on these design features to ensure control of the operating characteristics.
- 3 June 2024
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 24 (1) , 1-12
Open AccessMulti-arm multi-stage (MAMS) randomised selection designs: impact of treatment selection rules on the operating characteristics
Background: Multi-arm multi-stage (MAMS) randomised trial designs have been proposed to evaluate multiple research questions in the confirmatory setting. In designs with several interventions, such as the 8-arm 3-stage ROSSINI-2 trial for preventing surgical wound infection, there are likely to be strict limits on the number of individuals that can be recruited or the funds available to support the protocol. These limitations may mean that not all research treatments can continue to accrue the required sample size for the definitive analysis of the primary outcome measure at the final stage. In these cases, an additional treatment selection rule can be applied at the early stages of the trial to restrict the maximum number of research arms that can progress to the subsequent stage(s). This article provides guidelines on how to implement treatment selection within the MAMS framework. It explores the impact of treatment selection rules, interim lack-of-benefit stopping boundaries and the timing of treatment selection on the operating characteristics of the MAMS selection design. Methods: We outline the steps to design a MAMS selection trial. Extensive simulation studies are used to explore the maximum/expected sample sizes, familywise type I error rate (FWER), and overall power of the design under both binding and non-binding interim stopping boundaries for lack-of-benefit. Results: Pre-specification of a treatment selection rule reduces the maximum sample size by approximately 25% in our simulations. The familywise type I error rate of a MAMS selection design is smaller than that of the standard MAMS design with similar design specifications without the additional treatment selection rule. In designs with strict selection rules - for example, when only one research arm is selected from 7 arms - the final stage significance levels can be relaxed for the primary analyses to ensure that the overall type I error for the trial is not underspent. When conducting treatment selection from several treatment arms, it is important to select a large enough subset of research arms (that is, more than one research arm) at early stages to maintain the overall power at the pre-specified level. Conclusions: Multi-arm multi-stage selection designs gain efficiency over the standard MAMS design by reducing the overall sample size. Diligent pre-specification of the treatment selection rule, final stage significance level and interim stopping boundaries for lack-of-benefit are key to controlling the operating characteristics of a MAMS selection design. We provide guidance on these design features to ensure control of the operating characteristics.
- Open Access
- 12 March 2024
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 13 (6) , 1623
Predicting Long-Term Childhood Survival of Newborns with Congenital Heart Defects: A Population-Based, Prospective Cohort Study (EPICARD)
Backgroud: Congenital heart defects (CHDs) are the most frequent group of major congenital anomalies, accounting for almost 1% of all births. They comprise a very heterogeneous group of birth defects in terms of their severity, clinical management, epidemiology, and embryologic origins. Taking this heterogeneity into account is an important imperative to provide reliable prognostic information to patients and their caregivers, as well as to compare results between centers or to assess alternative diagnostic and treatment strategies. The Anatomic and Clinical Classification of CHD (ACC-CHD) aims to facilitate both the CHD coding process and data analysis in clinical and epidemiological studies. The objectives of the study were to (1) Describe the long-term childhood survival of newborns with CHD, and (2) Develop and validate predictive models of infant mortality based on the ACC-CHD. Methods: This study wasbased on data from a population-based, prospective cohort study: Epidemiological Study of Children with Congenital Heart Defects (EPICARD). The final study population comprised 1881 newborns with CHDs after excluding cases that were associated with chromosomal and other anomalies. Statistical analysis included non-parametric survival analysis and flexible parametric survival models. The predictive performance of models was assessed by Harrell’s C index and the Royston–Sauerbrei , with internal validation by bootstrap. Results: The overall 8-year survival rate for newborns with isolated CHDs was 0.96 [0.93–0.95]. There was a substantial difference between the survival rate of the categories of ACC-CHD. The highest and lowest 8-year survival rates were 0.995 [0.989–0.997] and 0.34 [0.21–0.50] for “interatrial communication abnormalities and ventricular septal defects” and “functionally univentricular heart”, respectively. Model discrimination, as measured by Harrell’s C, was 87% and 89% for the model with ACC-CHD alone and the full model, which included other known predictors of infant mortality, respectively. The predictive performance, as measured by , was 45% and 50% for the ACC-CHD alone and the full model. These measures were essentially the same after internal validation by bootstrap. Conclusions: The ACC-CHD classification provided the basis of a highly discriminant survival model with good predictive ability for the 8-year survival of newborns with CHDs. Prediction of individual outcomes remains an important clinical and statistical challenge.- 12 March 2024
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 13 (6) , 1623
Open AccessPredicting Long-Term Childhood Survival of Newborns with Congenital Heart Defects: A Population-Based, Prospective Cohort Study (EPICARD)
Backgroud: Congenital heart defects (CHDs) are the most frequent group of major congenital anomalies, accounting for almost 1% of all births. They comprise a very heterogeneous group of birth defects in terms of their severity, clinical management, epidemiology, and embryologic origins. Taking this heterogeneity into account is an important imperative to provide reliable prognostic information to patients and their caregivers, as well as to compare results between centers or to assess alternative diagnostic and treatment strategies. The Anatomic and Clinical Classification of CHD (ACC-CHD) aims to facilitate both the CHD coding process and data analysis in clinical and epidemiological studies. The objectives of the study were to (1) Describe the long-term childhood survival of newborns with CHD, and (2) Develop and validate predictive models of infant mortality based on the ACC-CHD. Methods: This study wasbased on data from a population-based, prospective cohort study: Epidemiological Study of Children with Congenital Heart Defects (EPICARD). The final study population comprised 1881 newborns with CHDs after excluding cases that were associated with chromosomal and other anomalies. Statistical analysis included non-parametric survival analysis and flexible parametric survival models. The predictive performance of models was assessed by Harrell’s C index and the Royston–Sauerbrei , with internal validation by bootstrap. Results: The overall 8-year survival rate for newborns with isolated CHDs was 0.96 [0.93–0.95]. There was a substantial difference between the survival rate of the categories of ACC-CHD. The highest and lowest 8-year survival rates were 0.995 [0.989–0.997] and 0.34 [0.21–0.50] for “interatrial communication abnormalities and ventricular septal defects” and “functionally univentricular heart”, respectively. Model discrimination, as measured by Harrell’s C, was 87% and 89% for the model with ACC-CHD alone and the full model, which included other known predictors of infant mortality, respectively. The predictive performance, as measured by , was 45% and 50% for the ACC-CHD alone and the full model. These measures were essentially the same after internal validation by bootstrap. Conclusions: The ACC-CHD classification provided the basis of a highly discriminant survival model with good predictive ability for the 8-year survival of newborns with CHDs. Prediction of individual outcomes remains an important clinical and statistical challenge. - Open Access
- 12 January 2024
- Published by MDPI AG in Preprints.org
Predicting Long-Term Childhood Survival of Newborns with Congenital Heart Defects: A Population-Based, Prospective Cohort Study (EPICARD)
Introduction: Congenital heart defects (CHD) are the most frequent group of major congenital anomalies, accounting for almost 1% of all births. They comprise a very heterogeneous group of birth defects in terms of their severity, clinical management, epidemiology and embryologic origins. Taking this heterogeneity into account is an important imperative to provide reliable prognostic information to patients and their caregivers, as well as to compare results between centers or to assess alternative diagnostic and treatment strategies. The Anatomic and Clinical Classification of CHD (ACC-CHD) aims to facilitate both the CHD coding process and data analysis in clinical and epidemiological studies. Objectives: 1) To describe the long-term childhood survival of newborns with CHD and 2) To develop and validate predictive models of infant mortality based on the ACC-CHD. Materials and Methods: This study is based on data from a population-based, prospective cohort study: Epidemiological Study of Children with Congenital Heart Defects (EPICARD). The final study population comprised 1881 newborns with CHD after excluding cases that were associated with chromosomal and other anomalies. Statistical analysis included non-parametric survival analysis and flexible parametric survival models. The predictive performance of models was assessed by Harrell’s C index and the Royston-Sauerbrei R2 with internal validation by bootstrap. Results: The overall 8-year survival rate for newborns with isolated CHD was 0.96 [0.93- 0.95]. There was a substantial difference between the survival rate of the categories of ACC-CHD. The highest and lowest 8-year survival rates were 0.995 [0.989-0.997] and 0.34 [0.21-0.50] for “interatrial communication abnormalities and ventricular septal defects” and "functionally univentricular heart", respectively. Model discrimination as measured by Harrell’s C was 87% and 89% for the model with ACC-CHD alone and the full model, which included other known predictors of infant mortality, respectively. The predictive performance as measured by R2 was 45% and 50%, for the ACC-CHD alone and the full model. These measures were essentially the same after internal validation by bootstrap. Conclusion: The ACC-CHD classification provided the basis of a highly discriminant survival model with good predictive ability for the 8-year survival of newborns with CHD. Prediction of individual outcomes remains an important clinical and statistical challenge.
- 12 January 2024
- Published by MDPI AG in Preprints.org
Open AccessPredicting Long-Term Childhood Survival of Newborns with Congenital Heart Defects: A Population-Based, Prospective Cohort Study (EPICARD)
Introduction: Congenital heart defects (CHD) are the most frequent group of major congenital anomalies, accounting for almost 1% of all births. They comprise a very heterogeneous group of birth defects in terms of their severity, clinical management, epidemiology and embryologic origins. Taking this heterogeneity into account is an important imperative to provide reliable prognostic information to patients and their caregivers, as well as to compare results between centers or to assess alternative diagnostic and treatment strategies. The Anatomic and Clinical Classification of CHD (ACC-CHD) aims to facilitate both the CHD coding process and data analysis in clinical and epidemiological studies. Objectives: 1) To describe the long-term childhood survival of newborns with CHD and 2) To develop and validate predictive models of infant mortality based on the ACC-CHD. Materials and Methods: This study is based on data from a population-based, prospective cohort study: Epidemiological Study of Children with Congenital Heart Defects (EPICARD). The final study population comprised 1881 newborns with CHD after excluding cases that were associated with chromosomal and other anomalies. Statistical analysis included non-parametric survival analysis and flexible parametric survival models. The predictive performance of models was assessed by Harrell’s C index and the Royston-Sauerbrei R2 with internal validation by bootstrap. Results: The overall 8-year survival rate for newborns with isolated CHD was 0.96 [0.93- 0.95]. There was a substantial difference between the survival rate of the categories of ACC-CHD. The highest and lowest 8-year survival rates were 0.995 [0.989-0.997] and 0.34 [0.21-0.50] for “interatrial communication abnormalities and ventricular septal defects” and "functionally univentricular heart", respectively. Model discrimination as measured by Harrell’s C was 87% and 89% for the model with ACC-CHD alone and the full model, which included other known predictors of infant mortality, respectively. The predictive performance as measured by R2 was 45% and 50%, for the ACC-CHD alone and the full model. These measures were essentially the same after internal validation by bootstrap. Conclusion: The ACC-CHD classification provided the basis of a highly discriminant survival model with good predictive ability for the 8-year survival of newborns with CHD. Prediction of individual outcomes remains an important clinical and statistical challenge.
- Open Access
- 31 October 2023
- Published by SAGE Publications in Clinical Trials
- Vol. 21 (2) , 162-170
When should factorial designs be used for late-phase randomised controlled trials?
Background: A 2×2 factorial design evaluates two interventions (A versus control and B versus control) by randomising to control, A-only, B-only or both A and B together. Extended factorial designs are also possible (e.g. 3×3 or 2×2×2). Factorial designs often require fewer resources and participants than alternative randomised controlled trials, but they are not widely used. We identified several issues that investigators considering this design need to address, before they use it in a late-phase setting. Methods: We surveyed journal articles published in 2000–2022 relating to designing factorial randomised controlled trials. We identified issues to consider based on these and our personal experiences. Results: We identified clinical, practical, statistical and external issues that make factorial randomised controlled trials more desirable. Clinical issues are (1) interventions can be easily co-administered; (2) risk of safety issues from co-administration above individual risks of the separate interventions is low; (3) safety or efficacy data are wanted on the combination intervention; (4) potential for interaction (e.g. effect of A differing when B administered) is low; (5) it is important to compare interventions with other interventions balanced, rather than allowing randomised interventions to affect the choice of other interventions; (6) eligibility criteria for different interventions are similar. Practical issues are (7) recruitment is not harmed by testing many interventions; (8) each intervention and associated toxicities is unlikely to reduce either adherence to the other intervention or overall follow-up; (9) blinding is easy to implement or not required. Statistical issues are (10) a suitable scale of analysis can be identified; (11) adjustment for multiplicity is not required; (12) early stopping for efficacy or lack of benefit can be done effectively. External issues are (13) adequate funding is available and (14) the trial is not intended for licensing purposes. An overarching issue (15) is that factorial design should give a lower sample size requirement than alternative designs. Across designs with varying non-adherence, retention, intervention effects and interaction effects, 2×2 factorial designs require lower sample size than a three-arm alternative when one intervention effect is reduced by no more than 24%–48% in the presence of the other intervention compared with in the absence of the other intervention. Conclusions: Factorial designs are not widely used and should be considered more often using our issues to consider. Low potential for at most small to modest interaction is key, for example, where the interventions have different mechanisms of action or target different aspects of the disease being studied.
- 31 October 2023
- Published by SAGE Publications in Clinical Trials
- Vol. 21 (2) , 162-170
Open AccessWhen should factorial designs be used for late-phase randomised controlled trials?
Background: A 2×2 factorial design evaluates two interventions (A versus control and B versus control) by randomising to control, A-only, B-only or both A and B together. Extended factorial designs are also possible (e.g. 3×3 or 2×2×2). Factorial designs often require fewer resources and participants than alternative randomised controlled trials, but they are not widely used. We identified several issues that investigators considering this design need to address, before they use it in a late-phase setting. Methods: We surveyed journal articles published in 2000–2022 relating to designing factorial randomised controlled trials. We identified issues to consider based on these and our personal experiences. Results: We identified clinical, practical, statistical and external issues that make factorial randomised controlled trials more desirable. Clinical issues are (1) interventions can be easily co-administered; (2) risk of safety issues from co-administration above individual risks of the separate interventions is low; (3) safety or efficacy data are wanted on the combination intervention; (4) potential for interaction (e.g. effect of A differing when B administered) is low; (5) it is important to compare interventions with other interventions balanced, rather than allowing randomised interventions to affect the choice of other interventions; (6) eligibility criteria for different interventions are similar. Practical issues are (7) recruitment is not harmed by testing many interventions; (8) each intervention and associated toxicities is unlikely to reduce either adherence to the other intervention or overall follow-up; (9) blinding is easy to implement or not required. Statistical issues are (10) a suitable scale of analysis can be identified; (11) adjustment for multiplicity is not required; (12) early stopping for efficacy or lack of benefit can be done effectively. External issues are (13) adequate funding is available and (14) the trial is not intended for licensing purposes. An overarching issue (15) is that factorial design should give a lower sample size requirement than alternative designs. Across designs with varying non-adherence, retention, intervention effects and interaction effects, 2×2 factorial designs require lower sample size than a three-arm alternative when one intervention effect is reduced by no more than 24%–48% in the presence of the other intervention compared with in the absence of the other intervention. Conclusions: Factorial designs are not widely used and should be considered more often using our issues to consider. Low potential for at most small to modest interaction is key, for example, where the interventions have different mechanisms of action or target different aspects of the disease being studied.
- Open Access
- 5 October 2023
- Published by Springer Nature in Trials
- Vol. 24 (1) , 1-5
Medicines and Healthcare products Regulatory Agency’s “Consultation on proposals for legislative changes for clinical trials”: a response from the Trials Methodology Research Partnership Adaptive Designs Working Group, with a focus on data sharing
In the UK, the Medicines and Healthcare products Regulatory Agency consulted on proposals “to improve and strengthen the UK clinical trials legislation to help us make the UK the best place to research and develop safe and innovative medicines”. The purpose of the consultation was to help finalise the proposals and contribute to the drafting of secondary legislation. We discussed these proposals as members of the Trials Methodology Research Partnership Adaptive Designs Working Group, which is jointly funded by the Medical Research Council and the National Institute for Health and Care Research. Two topics arose frequently in the discussion: the emphasis on legislation, and the absence of questions on data sharing. It is our opinion that the proposals rely heavily on legislation to change practice. However, clinical trials are heterogeneous, and as a result some trials will struggle to comply with all of the proposed legislation. Furthermore, adaptive design clinical trials are even more heterogeneous than their non-adaptive counterparts, and face more challenges. Consequently, it is possible that increased legislation could have a greater negative impact on adaptive designs than non-adaptive designs. Overall, we are sceptical that the introduction of legislation will achieve the desired outcomes, with some exceptions. Meanwhile the topic of data sharing — making anonymised individual-level clinical trial data available to other investigators for further use — is entirely absent from the proposals and the consultation in general. However, as an aspect of the wider concept of open science and reproducible research, data sharing is an increasingly important aspect of clinical trials. The benefits of data sharing include faster innovation, improved surveillance of drug safety and effectiveness and decreasing participant exposure to unnecessary risk. There are already a number of UK-focused documents that discuss and encourage data sharing, for example, the Concordat on Open Research Data and the Medical Research Council’s Data Sharing Policy. We strongly suggest that data sharing should be the norm rather than the exception, and hope that the forthcoming proposals on clinical trials invite discussion on this important topic.
- 5 October 2023
- Published by Springer Nature in Trials
- Vol. 24 (1) , 1-5
Open AccessMedicines and Healthcare products Regulatory Agency’s “Consultation on proposals for legislative changes for clinical trials”: a response from the Trials Methodology Research Partnership Adaptive Designs Working Group, with a focus on data sharing
In the UK, the Medicines and Healthcare products Regulatory Agency consulted on proposals “to improve and strengthen the UK clinical trials legislation to help us make the UK the best place to research and develop safe and innovative medicines”. The purpose of the consultation was to help finalise the proposals and contribute to the drafting of secondary legislation. We discussed these proposals as members of the Trials Methodology Research Partnership Adaptive Designs Working Group, which is jointly funded by the Medical Research Council and the National Institute for Health and Care Research. Two topics arose frequently in the discussion: the emphasis on legislation, and the absence of questions on data sharing. It is our opinion that the proposals rely heavily on legislation to change practice. However, clinical trials are heterogeneous, and as a result some trials will struggle to comply with all of the proposed legislation. Furthermore, adaptive design clinical trials are even more heterogeneous than their non-adaptive counterparts, and face more challenges. Consequently, it is possible that increased legislation could have a greater negative impact on adaptive designs than non-adaptive designs. Overall, we are sceptical that the introduction of legislation will achieve the desired outcomes, with some exceptions. Meanwhile the topic of data sharing — making anonymised individual-level clinical trial data available to other investigators for further use — is entirely absent from the proposals and the consultation in general. However, as an aspect of the wider concept of open science and reproducible research, data sharing is an increasingly important aspect of clinical trials. The benefits of data sharing include faster innovation, improved surveillance of drug safety and effectiveness and decreasing participant exposure to unnecessary risk. There are already a number of UK-focused documents that discuss and encourage data sharing, for example, the Concordat on Open Research Data and the Medical Research Council’s Data Sharing Policy. We strongly suggest that data sharing should be the norm rather than the exception, and hope that the forthcoming proposals on clinical trials invite discussion on this important topic.
- Open Access
- 5 April 2023
- Published by Wiley in Statistics in Medicine
- Vol. 42 (14) , 2496-2520
Point estimation for adaptive trial designs II: Practical considerations and guidance
In adaptive clinical trials, the conventional end‐of‐trial point estimate of a treatment effect is prone to bias, that is, a systematic tendency to deviate from its true value. As stated in recent FDA guidance on adaptive designs, it is desirable to report estimates of treatment effects that reduce or remove this bias. However, it may be unclear which of the available estimators are preferable, and their use remains rare in practice. This article is the second in a two‐part series that studies the issue of bias in point estimation for adaptive trials. Part I provided a methodological review of approaches to remove or reduce the potential bias in point estimation for adaptive designs. In part II, we discuss how bias can affect standard estimators and assess the negative impact this can have. We review current practice for reporting point estimates and illustrate the computation of different estimators using a real adaptive trial example (including code), which we use as a basis for a simulation study. We show that while on average the values of these estimators can be similar, for a particular trial realization they can give noticeably different values for the estimated treatment effect. Finally, we propose guidelines for researchers around the choice of estimators and the reporting of estimates following an adaptive design. The issue of bias should be considered throughout the whole lifecycle of an adaptive design, with the estimation strategy prespecified in the statistical analysis plan. When available, unbiased or bias‐reduced estimates are to be preferred.
- 5 April 2023
- Published by Wiley in Statistics in Medicine
- Vol. 42 (14) , 2496-2520
Open AccessPoint estimation for adaptive trial designs II: Practical considerations and guidance
In adaptive clinical trials, the conventional end‐of‐trial point estimate of a treatment effect is prone to bias, that is, a systematic tendency to deviate from its true value. As stated in recent FDA guidance on adaptive designs, it is desirable to report estimates of treatment effects that reduce or remove this bias. However, it may be unclear which of the available estimators are preferable, and their use remains rare in practice. This article is the second in a two‐part series that studies the issue of bias in point estimation for adaptive trials. Part I provided a methodological review of approaches to remove or reduce the potential bias in point estimation for adaptive designs. In part II, we discuss how bias can affect standard estimators and assess the negative impact this can have. We review current practice for reporting point estimates and illustrate the computation of different estimators using a real adaptive trial example (including code), which we use as a basis for a simulation study. We show that while on average the values of these estimators can be similar, for a particular trial realization they can give noticeably different values for the estimated treatment effect. Finally, we propose guidelines for researchers around the choice of estimators and the reporting of estimates following an adaptive design. The issue of bias should be considered throughout the whole lifecycle of an adaptive design, with the estimation strategy prespecified in the statistical analysis plan. When available, unbiased or bias‐reduced estimates are to be preferred.