False discovery rates: a new deal
Top Cited Papers
Open Access
- 17 October 2016
- journal article
- research article
- Published by Oxford University Press (OUP) in Biostatistics
- Vol. 18 (2) , 275-294
Abstract
We introduce a new Empirical Bayes approach for large-scale hypothesis testing, including estimating false discovery rates (FDRs), and effect sizes. This approach has two key differences from existing approaches to FDR analysis. First, it assumes that the distribution of the actual (unobserved) effects is unimodal, with a mode at 0. This “unimodal assumption” (UA), although natural in many contexts, is not usually incorporated into standard FDR analysis, and we demonstrate how incorporating it brings many benefits. Specifically, the UA facilitates efficient and robust computation—estimating the unimodal distribution involves solving a simple convex optimization problem—and enables more accurate inferences provided that it holds. Second, the method takes as its input two numbers for each test (an effect size estimate and corresponding standard error), rather than the one number usually used (|$p$| value or |$z$| score). When available, using two numbers instead of one helps account for variation in measurement precision across tests. It also facilitates estimation of effects, and unlike standard FDR methods, our approach provides interval estimates (credible regions) for each effect in addition to measures of significance. To provide a bridge between interval estimates and significance measures, we introduce the term “local false sign rate” to refer to the probability of getting the sign of an effect wrong and argue that it is a superior measure of significance than the local FDR because it is both more generally applicable and can be more robustly estimated. Our methods are implemented in an R package ashr available from http://github.com/stephens999/ashr.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- Improving accuracy of genomic predictions within and between dairy cattle breeds with imputed high-density single nucleotide polymorphism panelsJournal of Dairy Science, 2012
- Why We (Usually) Don't Have to Worry About Multiple ComparisonsJournal of Research on Educational Effectiveness, 2012
- Using control genes to correct for unwanted variation in microarray dataBiostatistics, 2011
- General maximum likelihood empirical Bayes estimation of normal meansThe Annals of Statistics, 2009
- Practical Issues in Imputation-Based Association MappingPLOS Genetics, 2008
- Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable AnalysisPLOS Genetics, 2007
- Principal components analysis corrects for stratification in genome-wide association studiesNature Genetics, 2006
- False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected ParametersJournal of the American Statistical Association, 2005
- Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray ExperimentsStatistical Applications in Genetics and Molecular Biology, 2004
- Empirical bayes methods and false discovery rates for microarraysGenetic Epidemiology, 2002