Control of the mean number of false discoveries, Bonferroni and stability of multiple testing
Authors:
- Alexander GordonAGAlexander Gordon
- Galina GlazkoGGGalina Glazko
- Xing QiuXQXing Qiu
- Andrei YakovlevAYAndrei Yakovlev
Open Access
- 1 June 2007
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 1 (1) , 179-190
Abstract
The Bonferroni multiple testing procedure is commonly perceived as being overly conservative in large-scale simultaneous testing situations such as those that arise in microarray data analysis. The objective of the present study is to show that this popular belief is due to overly stringent requirements that are typically imposed on the procedure rather than to its conservative nature. To get over its notorious conservatism, we advocate using the Bonferroni selection rule as a procedure that controls the per family error rate (PFER). The present paper reports the first study of stability properties of the Bonferroni and Benjamini–Hochberg procedures. The Bonferroni procedure shows a superior stability in terms of the variance of both the number of true discoveries and the total number of discoveries, a property that is especially important in the presence of correlations between individual p-values. Its stability and the ability to provide strong control of the PFER make the Bonferroni procedure an attractive choice in microarray studies.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Utility of correlation measures in analysis of gene expressionNeuroRX, 2006
- Generalizations of the familywise error rateThe Annals of Statistics, 2005
- Correlation Between Gene Expression Levels and Limitations of the Empirical Bayes Methodology for Finding Differentially Expressed GenesStatistical Applications in Genetics and Molecular Biology, 2005
- Large-Scale Simultaneous Hypothesis TestingJournal of the American Statistical Association, 2004
- Multiple Testing. Part I. Single-Step Procedures for Control of General Type I Error RatesStatistical Applications in Genetics and Molecular Biology, 2004
- Robbins, empirical Bayes and microarraysThe Annals of Statistics, 2003
- Identifying differentially expressed genes using false discovery rate controlling proceduresBioinformatics, 2003
- Multiple Hypothesis Testing in Microarray ExperimentsStatistical Science, 2003
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- On the Adaptive Control of the False Discovery Rate in Multiple Testing with Independent StatisticsJournal of Educational and Behavioral Statistics, 2000