A Robust AUC Maximization Framework With Simultaneous Outlier Detection and Feature Selection for Positive-Unlabeled Classification
- 9 October 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 30 (10) , 3072-3083
Abstract
The positive-unlabeled (PU) classification is a common scenario in real-world applications such as healthcare, text classification, and bioinformatics, in which we only observe a few samples labeled as “positive” together with a large volume of “unlabeled” samples that may contain both positive and negative samples. Building robust classifiers for the PU problem is very challenging, especially for complex data where the negative samples overwhelm and mislabeled samples or corrupted features exist. To address these three issues, we propose a robust learning framework that unifies area under the curve maximization (a robust metric for biased labels), outlier detection (for excluding wrong labels), and feature selection (for excluding corrupted features). The generalization error bounds are provided for the proposed model that give valuable insight into the theoretical performance of the method and lead to useful practical guidance, e.g., to train a model, we find that the included unlabeled samples are sufficient as long as the sample size is comparable to the number of positive samples in the training process. Empirical comparisons and two real-world applications on surgical site infection (SSI) and EEG seizure detection are also conducted to show the effectiveness of the proposed model.Keywords
All Related Versions
Funding Information
- National Science Foundation (1714136)
- NEC fellowship
- IBM Faculty Award
- Sichuan Science and Technology Program (2018JY0607)
- Fundamental Research Funds for the Central Universities (JBK1801080)
- Division of Computing and Communication Foundations (1715027)
- National Science Foundation (DMS 1620957)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (U54HD083092)
- NIH/NINDS (1R01NS100893)
This publication has 33 references indexed in Scilit:
- Positive-unlabeled learning for disease gene identificationBioinformatics, 2012
- The benefit of group sparsityThe Annals of Statistics, 2010
- Sparse inverse covariance estimation with the graphical lassoBiostatistics, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Empirical Study on Applications of Data Mining Techniques in HealthcareJournal of Computer Science, 2006
- Greed is Good: Algorithmic Results for Sparse ApproximationIEEE Transactions on Information Theory, 2004
- Robust methods for partial least squares regressionJournal of Chemometrics, 2003
- Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretationQuarterly Journal of the Royal Meteorological Society, 2002
- Estimating the Support of a High-Dimensional DistributionNeural Computation, 2001
- Outlier detection in multivariate calibrationChemometrics and Intelligent Laboratory Systems, 1995