Evaluation of tools for differential gene expression analysis by RNA-seq on a 48 biological replicate experiment
Authors:
- Nicholas J. SchurchNSNicholas J. Schurch
- Christian ColeCCChristian Cole
- Alexander SherstnevASAlexander Sherstnev
- Gordon G. SimpsonGSGordon G. Simpson
- Tom Owen-HughesTOTom Owen-Hughes
- Mark BlaxterMBMark Blaxter
- Geoffrey J. BartonGBGeoffrey J. Barton
Preprint
Abstract
An RNA-seq experiment with 48 biological replicates in each of 2 conditions was performed to determine the number of biological replicates ($n_r$) required, and to identify the most effective statistical analysis tools for identifying differential gene expression (DGE). When $n_r=3$, seven of the nine tools evaluated give true positive rates (TPR) of only 20 to 40 percent. For high fold-change genes ($|log_{2}(FC)|\gt2$) the TPR is $\gt85$ percent. Two tools performed poorly; over- or under-predicting the number of differentially expressed genes. Increasing replication gives a large increase in TPR when considering all DE genes but only a small increase for high fold-change genes. Achieving a TPR $\gt85$% across all fold-changes requires $n_r\gt20$. For future RNA-seq experiments these results suggest $n_r\gt6$, rising to $n_r\gt12$ when identifying DGE irrespective of fold-change is important. For $6 \lt n_r \lt 12$, superior TPR makes edgeR the leading tool tested. For $n_r \ge12$, minimizing false positives is more important and DESeq outperforms the other tools.
Keywords
All Related Versions
- Version 1, 2015-05-08, ArXiv
- Version 2, 2015-06-08, ArXiv
- Published version: RNA, 22 (6), 839.
This publication has 58 references indexed in Scilit:
- Differential gene and transcript expression analysis of RNA-seq experiments with TopHat and CufflinksNature Protocols, 2012
- Snf2-family proteins: chromatin remodellers for any occasionCurrent Opinion in Chemical Biology, 2011
- Sequencing technology does not eliminate biological variabilityNature Biotechnology, 2011
- How to map billions of short reads onto genomesNature Biotechnology, 2009
- Confidence Intervals for the Mean of a Log-Normal DistributionJournal of Statistics Education, 2005
- Fundamentals of experimental design for cDNA microarraysNature Genetics, 2002
- Whole-genome expression analysis of snf/swi mutants of Saccharomyces cerevisiaeProceedings of the National Academy of Sciences, 2000
- Characterization of the yeast SWI1, SWI2, and SWI3 genes, which encode a global activator of transcriptionCell, 1992
- A functional interaction between the C-terminal domain of RNA polymerase II and the negative regulator SIN1Cell, 1991
- Five SWI genes are required for expression of the HO gene in yeastJournal of Molecular Biology, 1984