Psscl: A Progressive Sample Selection Framework with Contrastive Loss Designed for Noisy Labels
Authors:
- Qian ZhangQZQian Zhang
- Yi ZhuYZYi Zhu
- Filipe CordeiroFCFilipe Cordeiro
Preprint
- 3 April 2024
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Large-scale image datasets frequently contain unavoidable noisy labels, resulting in overfitting in deep neural networks and declining performance. Most existing methods for learning from noisy labels operate as one-stage frameworks, where training data division and semi-supervised learning (SSL) are intertwined for optimization. Accordingly, their effectiveness is significantly influenced by the precision of the separated clean set, prior knowledge of noise, and the robustness of SSL. In this paper, we propose a progressive sample selection framework with contrastive loss for noisy labels named PSSCL. This framework operates in two stages, using robust and contrastive losses to augment the robustness of the model. The first stage focuses on identifying a small clean set through a long-term confidence detection strategy, while the second stage aims to enhance performance by expanding this clean set. PSSCL demonstrates significant improvement across various benchmarks when compared with state-of-the-art methods. The code will be available at https://github.com/LanXiaoPang613/PSSCL.Keywords
This publication has 21 references indexed in Scilit:
- Dynamics-aware loss for learning with label noisePattern Recognition, 2023
- Combining layered label correction and mixup supervised contrastive learning to learn noisy labelsInformation Sciences, 2023
- On better detecting and leveraging noisy samples for learning with severe label noisePattern Recognition, 2022
- ScanMix: Learning from Severe Label Noise via Semantic Clustering and Semi-Supervised LearningPattern Recognition, 2022
- Self-paced resistance learning against overfitting on noisy labelsPattern Recognition, 2022
- Contrastive label correction for noisy label learningInformation Sciences, 2022
- Exploiting Cross-Modal Prediction and Relation Consistency for Semisupervised Image CaptioningIEEE Transactions on Cybernetics, 2022
- Selective-Supervised Contrastive Learning with Noisy Labels2022
- Multi-Objective Interpolation Training for Robustness to Label Noise2021
- Food-101 – Mining Discriminative Components with Random Forests2014