ROCS: Receiver Operating Characteristic Surface for Class-Skewed High-Throughput Data
Author:
Open Access
- 6 July 2012
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 7 (7) , e40598
Abstract
The receiver operating characteristic (ROC) curve is an important tool to gauge the performance of classifiers. In certain situations of high-throughput data analysis, the data is heavily class-skewed, i.e. most features tested belong to the true negative class. In such cases, only a small portion of the ROC curve is relevant in practical terms, rendering the ROC curve and its area under the curve (AUC) insufficient for the purpose of judging classifier performance. Here we define an ROC surface (ROCS) using true positive rate (TPR), false positive rate (FPR), and true discovery rate (TDR). The ROC surface, together with the associated quantities, volume under the surface (VUS) and FDR-controlled area under the ROC curve (FCAUC), provide a useful approach for gauging classifier performance on class-skewed high-throughput data. The implementation as an R package is available at http://userwww.service.emory.edu/~tyu8/ROCS/.Keywords
This publication has 10 references indexed in Scilit:
- Caveats and pitfalls of ROC analysis in clinical microarray research (and how to avoid them)Briefings in Bioinformatics, 2011
- pROC: an open-source package for R and S+ to analyze and compare ROC curvesBMC Bioinformatics, 2011
- A CROC stronger than ROC: measuring, visualizing and optimizing early retrievalBioinformatics, 2010
- Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker researchJournal of Clinical Pathology, 2008
- BGX: a Bioconductor package for the Bayesian integrated analysis of Affymetrix GeneChipsBMC Bioinformatics, 2007
- A forward-backward fragment assembling algorithm for the identification of genomic amplification and deletion breakpoints using high-density single nucleotide polymorphism (SNP) arrayBMC Bioinformatics, 2007
- An introduction to ROC analysisPattern Recognition Letters, 2006
- The partial area under the summary ROC curveStatistics in Medicine, 2005
- Preferred analysis methods for Affymetrix GeneChips revealed by a wholly defined control datasetGenome Biology, 2005
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingJournal of the Royal Statistical Society Series B: Statistical Methodology, 1995