The population-wise error rate for clinical trials with overlapping populations
Open Access
- 1 December 2022
- journal article
- research article
- Published by SAGE Publications in Statistical Methods in Medical Research
- Vol. 32 (2) , 334-352
Abstract
We introduce a new multiple type I error criterion for clinical trials with multiple, overlapping populations. Such trials are of interest in precision medicine where the goal is to develop treatments that are targeted to specific sub-populations defined by genetic and/or clinical biomarkers. The new criterion is based on the observation that not all type I errors are relevant to all patients in the overall population. If disjoint sub-populations are considered, no multiplicity adjustment appears necessary, since a claim in one sub-population does not affect patients in the other ones. For intersecting sub-populations we suggest to control the average multiple type I error rate, i.e. the probability that a randomly selected patient will be exposed to an inefficient treatment. We call this the population-wise error rate, exemplify it by a number of examples and illustrate how to control it with an adjustment of critical boundaries or adjusted [ ]-values. We furthermore define corresponding simultaneous confidence intervals. We finally illustrate the power gain achieved by passing from family-wise to population-wise error rate control with two simple examples and a recently suggested multiple-testing approach for umbrella trials.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (01EK1503B)
This publication has 23 references indexed in Scilit:
- PATHOS: a phase II/III trial of risk-stratified, reduced intensity adjuvant treatment in patients undergoing transoral surgery for Human papillomavirus (HPV) positive oropharyngeal cancerBMC Cancer, 2015
- An approach to confirmatory testing of subpopulations in clinical trialsBiometrical Journal, 2015
- Consensus Report of a Joint NCI Thoracic Malignancies Steering Committee: FDA Workshop on Strategies for Integrating Biomarkers into Clinical Development of New Therapies for Lung Cancer Leading to the Inception of “Master Protocols” in Lung CancerJournal of Thoracic Oncology, 2014
- A new class of powerful and informative simultaneous confidence intervalsStatistics in Medicine, 2014
- Comment: A Fruitful Resolution to Simpson’s Paradox via Multiresolution InferenceThe American Statistician, 2014
- Evaluating Many Treatments and Biomarkers in Oncology: A New DesignJournal of Clinical Oncology, 2013
- Comparison of stratified primary care management for low back pain with current best practice (STarT Back): a randomised controlled trialThe Lancet, 2011
- Alternative Confidence Regions for Bonferroni‐Based Closed‐Testing Procedures that are not Alpha‐ExhaustiveBiometrical Journal, 2009
- Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncologyStatistics in Medicine, 2009
- Compatible simultaneous lower confidence bounds for the Holm procedure and other Bonferroni‐based closed testsStatistics in Medicine, 2008