An Unbiased Risk Estimator for Partial Label Learning with Augmented Classes
Open Access
- 14 December 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 15 (6) , 1-22
Abstract
Partial Label Learning (PLL) is a typical weakly supervised learning task, which assumes each training instance is annotated with a set of candidate labels containing the ground-truth label. Recent PLL methods adopt identification-based disambiguation to alleviate the influence of false positive labels and achieve promising performance. However, they require all classes in the test set to have appeared in the training set, ignoring the fact that new classes will keep emerging in real applications. To address this issue, in this article, we focus on the problem of Partial Label Learning with Augmented Class (PLLAC), where one or more augmented classes are not visible in the training stage but appear in the inference stage. Specifically, we propose an unbiased risk estimator with theoretical guarantees for PLLAC, which estimates the distribution of augmented classes by differentiating the distribution of known classes from unlabeled data and can be equipped with arbitrary PLL loss functions. Besides, we provide a theoretical analysis of the estimation error bound of the estimator, which guarantees the convergence of the empirical risk minimizer to the true risk minimizer as the number of training data tends to infinity. Furthermore, we add a risk-penalty regularization term in the optimization objective to alleviate the influence of the over-fitting issue caused by negative empirical risk. Extensive experiments on benchmark, UCI, and real-world datasets demonstrate the effectiveness of the proposed approach.Keywords
All Related Versions
Funding Information
- Chongqing Science and Technology Bureau (CSTB2022TTAD-KPX0180)
This publication has 24 references indexed in Scilit:
- Progressive Frame-Proposal Mining for Weakly Supervised Video Object DetectionIEEE Transactions on Image Processing, 2024
- A brief introduction to weakly supervised learningNational Science Review, 2017
- Learning from Ambiguously Labeled Face ImagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Probability Models for Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Multilabel Image Classification Via High-Order Label Correlation Driven Active LearningIEEE Transactions on Image Processing, 2014
- Learning by Associating Ambiguously Labeled Images2013
- A Review on Multi-Label Learning AlgorithmsIEEE Transactions on Knowledge and Data Engineering, 2013
- Toward Open Set RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Learning from ambiguously labeled images2009
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998