Family‐Wise Error Rate Control in Clinical Trials With Overlapping Populations
Open Access
- 25 August 2026
- journal article
- Published by Wiley in Statistics in Medicine
- Vol. 45 (20-22)
Abstract
We consider clinical trials with multiple, overlapping patient populations that test multiple treatment policies specifically tailored to these populations. Such designs may lead to multiplicity issues, as false statements will affect several populations. For type I error control, often the family‐wise error rate (FWER) is controlled, which is the probability to reject at least one true null hypothesis. If the joint distribution of the test statistics is known, the FWER level can be exhausted by determining critical values or adjusted ‐levels. The adjustment is typically done under the common ANOVA assumptions. However, the performed tests are then only valid under the rather strong assumption of homogeneous null effects, that is, when the null hypothesis applies to all subpopulations and their intersections. We show that under cancelling null effects, when heterogeneous effects cancel out in some or all subpopulations, this procedure does not provide FWER control. We also suggest different alternatives and compare them in terms of FWER control and their power.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- New insights into adaptive enrichment designsStatistical Papers, 2023
- The population-wise error rate for clinical trials with overlapping populationsStatistical Methods in Medical Research, 2022
- Statistical Considerations for Subgroup AnalysesJournal of Thoracic Oncology, 2020
- Comparing a stratified treatment strategy with the standard treatment in randomized clinical trialsStatistics in Medicine, 2016
- Methods for identification and confirmation of targeted subgroups in clinical trials: A systematic reviewJournal of Biopharmaceutical Statistics, 2015
- Effect of Empirical Treatment With Moxifloxacin and Meropenem vs Meropenem on Sepsis-Related Organ Dysfunction in Patients With Severe SepsisJAMA, 2012
- Multiple Contrast Tests in the Presence of HeteroscedasticityBiometrical Journal, 2008
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986
- Parametric Empirical Bayes Inference: Theory and ApplicationsJournal of the American Statistical Association, 1983
- Data Analysis Using Stein's Estimator and its GeneralizationsJournal of the American Statistical Association, 1975