Collaborative Learning for Extremely Low Bit Asymmetric Hashing
- 2 March 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 33 (12) , 3675-3685
Abstract
Hashing techniques are in great demand for a wide range of real-world applications such as image retrieval and network compression. Nevertheless, existing approaches could hardly guarantee a satisfactory performance with the extremely low-bit (e.g., 4-bit) hash codes due to the severe information loss and the shrink of the discrete solution space. In this article, we propose a novel Collaborative Learning strategy that is tailored for generating high-quality low-bit hash codes. The core idea is to jointly distill bit-specific and informative representations for a group of pre-defined code lengths. The learning of short hash codes among the group can benefit from the manifold shared with other long codes, where multiple views from different hash codes provide the supplementary guidance and regularization, making the convergence faster and more stable. To achieve that, an asymmetric hashing framework with two variants of multi-head embedding structures is derived, termed as Multi-head Asymmetric Hashing (MAH), leading to great efficiency of training and querying. Extensive experiments on three benchmark datasets have been conducted to verify the superiority of the proposed MAH, and have shown that the 8-bit hash codes generated by MAH achieve 94.3 percent of the MAP 1 1.Mean Average Precision (MAP) score on the CIFAR-10 dataset, which significantly surpasses the performance of the 48-bit codes by the state-of-the-arts in image retrieval tasks.Keywords
All Related Versions
Funding Information
- ARC (FT130101530)
- National Natural Science Foundation of China (61628206)
This publication has 32 references indexed in Scilit:
- Zero-Shot Hashing via Transferring Supervised Knowledge2016
- A Fast Optimization Method for General Binary Code LearningIEEE Transactions on Image Processing, 2016
- Visual Coding in a Semantic Hierarchy2015
- Bit-Scalable Deep Hashing With Regularized Similarity Learning for Image Retrieval and Person Re-IdentificationIEEE Transactions on Image Processing, 2015
- Supervised Discrete Hashing2015
- Asymmetric Cyclical Hashing for Large Scale Image RetrievalIEEE Transactions on Multimedia, 2015
- Supervised hashing with latent factor models2014
- Iterative Quantization: A Procrustean Approach to Learning Binary Codes for Large-Scale Image RetrievalIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Semi-Supervised Hashing for Large-Scale SearchIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- NUS-WIDE2009