DIOR: Learning to Hash With Label Noise Via Dual Partition and Contrastive Learning
- 5 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 36 (4) , 1502-1517
Abstract
Due to the excellent computing efficiency, learning to hash has acquired broad popularity for Big Data retrieval. Although supervised hashing methods have achieved promising performance recently, they presume that all training samples are appropriately annotated. Unfortunately, label noise is ubiquitous owing to erroneous annotations in real-world applications, which could seriously deteriorate the retrieval performance due to imprecise supervised guidance and severe memorization of noisy data. Here we propose a comprehensive method DIOR to handle the difficulties of learning to hash with label noise. DIOR performs partitions from two complementary levels, namely sample level and parameter level. On the one hand, DIOR divides the dataset into a labeled set with clean samples and an unlabeled set with noisy samples using an ensemble of perturbed views. Then we train the network in a contrastive semi-supervised manner by reconstructing label embeddings for both reliable supervision of clean data and sufficient exploration of noisy data. On the other hand, inspired by recent pruning techniques, DIOR divides the parameters in the hashing network into crucial parameters and non-crucial parameters, and then optimizes them separately to reduce the overfitting of noisy data. Extensive experiments on four popular benchmark datasets demonstrate the effectiveness of DIOR.Keywords
This publication has 61 references indexed in Scilit:
- Noise-robust Deep Cross-Modal HashingInformation Sciences, 2021
- Pruning by explaining: A novel criterion for deep neural network pruningPattern Recognition, 2021
- End-To-End Supervised Product Quantization for Image Search and Retrieval2019
- DistillHash: Unsupervised Deep Hashing by Distilling Data Pairs2019
- Importance Estimation for Neural Network Pruning2019
- Unsupervised Binary Representation Learning with Deep Variational NetworksInternational Journal of Computer Vision, 2019
- An Efficient and Provable Approach for Mixture Proportion Estimation Using Linear Independence AssumptionIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2018
- Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach2017
- Deep Visual-Semantic Quantization for Efficient Image Retrieval2017
- On the Robustness of Decision Tree Learning Under Label Noise2017