Optimal weighted Bonferroni tests and their graphical extensions
- 11 December 2023
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 43 (3) , 475-500
Abstract
Regulatory guidelines mandate the strong control of the familywise error rate in confirmatory clinical trials with primary and secondary objectives. Bonferroni tests are one of the popular choices for multiple comparison procedures and are building blocks of more advanced procedures. It is usually of interest to find the optimal weighted Bonferroni split for multiple hypotheses. We consider two popular quantities as the optimization objectives, which are the disjunctive power and the conjunctive power. The former is the probability to reject at least one false hypothesis and the latter is the probability to reject all false hypotheses. We investigate the behavior of each of them as a function of different Bonferroni splits, given assumptions about the alternative hypotheses and correlations between test statistics. Under independent tests, unique optimal Bonferroni weights exist; under dependence, optimal Bonferroni weights may not be unique based on a fine grid search. In general, we propose an optimization algorithm based on constrained nonlinear optimization and multiple starting points. The proposed algorithm efficiently identifies optimal Bonferroni weights to maximize the disjunctive or conjunctive power. In addition, we apply the proposed algorithm to graphical approaches, which include many Bonferroni‐based multiple comparison procedures. Utilizing the closed testing principle, we adopt a two‐step approach to find optimal graphs using the disjunctive power. We also identify a class of closed test procedures that optimize the conjunctive power. We apply the proposed algorithm to a case study to illustrate the utility of optimal graphical approaches that reflect study objectives.Keywords
This publication has 40 references indexed in Scilit:
- Graphical approaches for multiple comparison procedures using weighted Bonferroni, Simes, or parametric testsBiometrical Journal, 2011
- Chain Procedures: A Class of Flexible Closed Testing Procedures With Clinical Trial ApplicationsStatistics in Biopharmaceutical Research, 2011
- Genome-Wide Significance Levels and Weighted Hypothesis TestingStatistical Science, 2009
- Power and sample size when multiple endpoints are consideredPharmaceutical Statistics, 2007
- A Method to Increase the Power of Multiple Testing Procedures Through Sample SplittingStatistical Applications in Genetics and Molecular Biology, 2006
- Sample sizes for clinical trials with Normal dataStatistics in Medicine, 2004
- The Evaluation of General Non-Centred Orthant ProbabilitiesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2003
- Comparison of Methods for the Computation of MultivariatetProbabilitiesJournal of Computational and Graphical Statistics, 2002
- On the Optimality of Some Multiple Comparison ProceduresThe Annals of Mathematical Statistics, 1972
- A Multiple Comparison Procedure for Comparing Several Treatments with a ControlJournal of the American Statistical Association, 1955