Mutual Filter Teaching for Open-Set Semi-Supervised Learning
- 27 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 7700-7708
Abstract
Open-set semi-supervised learning (OSSL) provides a practical solution by filtering out-of-distribution (OOD) samples from unlabeled data to guarantee the reliance on large unlabeled data in semi-supervised setting. However, existing OSSL methods mainly focus on identifying in-distribution (ID) samples and discarding OOD samples, while ignoring to make full use of samples that could not be exactly identified as ID or OOD samples. Those samples are more likely to be hard samples, which should be carefully explored to boost the performance in OSSL task. Hence, in this paper, we propose a novel framework, named Mutual Filter Teaching (MFT), where two networks are trained simultaneously to divide the unlabeled data into three parts: ID samples, OOD samples and hard samples. The samples are regarded as ID or OOD samples only if two networks give consistent decisions according to Mahalanobis distance between the unlabeled samples and their closest class prototypes. For those samples with inconsistent decisions, we treat them as hard samples and design an efficient mutual teaching scheme where the samples detected by only one network as positive samples are fed to its peer network for training. Furthermore, we propose to employ the prediction variance of two networks to dynamically rectify the learning from hard samples. Experiments on multiple benchmark datasets demonstrate that our approach achieves the state-of-the-art performance.Keywords
Funding Information
- National Natural Science Foundation of China (62271042, 62376021, 62302032, 62106017)
- Beijing Natural Science Foundation (L211015, 4232032)
- Natural Science Foundation of Hebei Province (F2022105018)
This publication has 15 references indexed in Scilit:
- Trash to Treasure: Harvesting OOD Data with Cross-Modal Matching for Open-Set Semi-Supervised Learning2021
- Unreliable-to-Reliable Instance Translation for Semi-Supervised Pedestrian DetectionIEEE Transactions on Multimedia, 2021
- Multi-task Curriculum Framework for Open-Set Semi-supervised Learning2020
- Randaugment: Practical automated data augmentation with a reduced search space2020
- Snowball: Iterative Model Evolution and Confident Sample Discovery for Semi-Supervised Learning on Very Small Labeled DatasetsIEEE Transactions on Multimedia, 2020
- Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancy2019
- Empirical Risk Minimization2017
- Deep Residual Learning for Image Recognition2016
- Food-101 – Mining Discriminative Components with Random Forests2014
- Iterative Reclassification Procedure for Constructing an Asymptotically Optimal Rule of Allocation in Discriminant AnalysisJournal of the American Statistical Association, 1975