Efficient Training for Positive Unlabeled Learning
- 30 July 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 41 (11) , 2584-2598
Abstract
Positive unlabeled (PU) learning is useful in various practical situations, where there is a need to learn a classifier for a class of interest from an unlabeled data set, which may contain anomalies as well as samples from unknown classes. The learning task can be formulated as an optimization problem under the framework of statistical learning theory. Recent studies have theoretically analyzed its properties and generalization performance, nevertheless, little effort has been made to consider the problem of scalability, especially when large sets of unlabeled data are available. In this work we propose a novel scalable PU learning algorithm that is theoretically proven to provide the optimal solution, while showing superior computational and memory performance. Experimental evaluation confirms the theoretical evidence and shows that the proposed method can be successfully applied to a large variety of real-world problems involving PU learning.Keywords
All Related Versions
Funding Information
- National Key R&D Program of China (2018YFB1004300)
- NSFC (61333014)
- Collaborative Innovation Center of Novel Software Technology and Industrialization
This publication has 41 references indexed in Scilit:
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Semi-supervised learning by disagreementKnowledge and Information Systems, 2009
- Semi-Supervised Learning (Chapelle, O. et al., Eds.; 2006) [Book reviews]IEEE Transactions on Neural Networks, 2009
- A Study on SMO-Type Decomposition Methods for Support Vector MachinesIEEE Transactions on Neural Networks, 2006
- Constructing boosting algorithms from SVMs: an application to one-class classificationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Estimating the Support of a High-Dimensional DistributionNeural Computation, 2001
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999
- Efficient noise-tolerant learning from statistical queriesJournal of the ACM, 1998
- The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenonIEEE Transactions on Geoscience and Remote Sensing, 1994
- Theory of reproducing kernelsTransactions of the American Mathematical Society, 1950