On dependence assumption in p-value based multiple test procedures
Author:
- 6 January 2023
- journal article
- research article
- Published by Taylor & Francis in Journal of Biopharmaceutical Statistics
- Vol. 33 (5) , 596-610
Abstract
There are various multiple comparison procedures used in confirmatory clinical studies and exploratory research for multiplicity adjustment. Among them are the Hochberg and Benjamini-Hochberg procedures. A common misconception is that these procedures control the type I error rate properly if the test statistics are independent or positively correlated. In fact, a much stronger positive dependence assumption needs to be satisfied to guarantee the type I error rate control. We give a comprehensive review of the dependence conditions used in multiple testing procedures. We show that a weaker positive dependence assumption may result an inflation of type I error rate by a factor of 2 and discuss the type I error rate control under certain negative dependence conditions.Keywords
Funding Information
- No funding
This publication has 77 references indexed in Scilit:
- Sparse inverse covariance estimation with the graphical lassoBiostatistics, 2007
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- Numerical computation of multivariate t -probabilities with application to power calculation of multiple contrastsJournal of Statistical Computation and Simulation, 1999
- Multiple Comparisons in the General Linear ModelJournal of Computational and Graphical Statistics, 1998
- The Factor Analytic Approach to Simultaneous Inference in the General Linear ModelJournal of Computational and Graphical Statistics, 1992
- A concept of negative dependence using stochastic orderingStatistics & Probability Letters, 1985
- A Family of Concepts of Dependence for Bivariate DistributionsJournal of the American Statistical Association, 1977
- Dependence and Aging Aspects of Multivariate SurvivalJournal of the American Statistical Association, 1972
- Rectangular Confidence Regions for the Means of Multivariate Normal DistributionsJournal of the American Statistical Association, 1967
- Multiple Comparisons among MeansJournal of the American Statistical Association, 1961