An Adaptive Moment estimation method for online AUC maximization
Open Access
- 23 April 2019
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 14 (4) , e0215426
Abstract
Area Under the ROC Curve (AUC) is a widely used metric for measuring classification performance. It has important theoretical and academic values to develop AUC maximization algorithms. Traditional methods often apply batch learning algorithm to maximize AUC which is inefficient and unscalable for large-scale applications. Recently some online learning algorithms have been introduced to maximize AUC by going through the data only once. However, these methods sometimes fail to converge to an optimal solution due to the fixed or rapid decay of learning rates. To tackle this problem, we propose an algorithm AdmOAM, Adaptive Moment estimation method for Online AUC Maximization. It applies the estimation of moments of gradients to accelerate the convergence and mitigates the rapid decay of the learning rates. We establish the regret bound of the proposed algorithm and implement extensive experiments to demonstrate its effectiveness and efficiency.Keywords
This publication has 16 references indexed in Scilit:
- Ensemble application of convolutional and recurrent neural networks for multi-label text categorization2017
- Deep learning for computational biologyMolecular Systems Biology, 2016
- A comprehensive comparison of random forests and support vector machines for microarray-based cancer classificationBMC Bioinformatics, 2008
- Using AUC and accuracy in evaluating learning algorithmsIEEE Transactions on Knowledge and Data Engineering, 2005
- On the Generalization Ability of On-Line Learning AlgorithmsIEEE Transactions on Information Theory, 2004
- Co-EM support vector learning2004
- Optimising area under the ROC curve using gradient descent2004
- AUC: A Better Measure than Accuracy in Comparing Learning Algorithms2003
- The meaning and use of the area under a receiver operating characteristic (ROC) curve.Radiology, 1982
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958