Label Guided Discrete Hashing for Cross-Modal Retrieval
- 25 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 23 (12) , 25236-25248
Abstract
Due to their low storage capacity and fast retrieval speed, hashing techniques have received much attention in cross-modal retrieval. However, there are some issues that need to be further explored. First, some existing hashing methods use the labels to construct the semantic similarity matrix between pairwise data, ignoring the potential manifold structure between heterogeneous data. Second, some existing methods underestimate the importance of multi-label and the gaps between different class labels, making the learned hash codes less discriminative. Third, few of them embed both manifold and balanced structures within the same model, and the relaxation of discrete constraints will lead to an increasing quantization error. To mitigate these problems, this paper proposes a novel supervised hashing method, termed Label Guided Discrete Hashing (LGDH), which simultaneously preserves the comprehensive manifold structure and discriminative balanced codes that are both constructed by label information into Hamming space. We develop a local category distribution of the nearest neighbors, to excavate the underlying manifold structure of heterogeneous data. To maximize the gaps of different categories, a balanced matrix is constructed by labels to generate hash codes with balanced bits. For multi-label data, we also design a novel multi-label manifold and balanced structure matrix to adapt the real-world scenarios. An effective discrete optimization method is used to optimize our proposed objective function instead of the relaxation one. Extensive experiments on three benchmark datasets verify the effectiveness of LGDH. The comparison results demonstrat that LGDH achieves about 2 $\%$ and 3 $\%$ improved to different cross-modal tasks on average.Keywords
Funding Information
- Guangxi Science and Technology (2019GXNSFFA245014, AD20159034)
- National Natural Science Foundation of China (62172120, 61936002)
- Guangxi Key Laboratory of Image and Graphic Intelligent Processing (GIIP2001)
This publication has 49 references indexed in Scilit:
- Learning Discriminative Binary Codes for Large-scale Cross-modal RetrievalIEEE Transactions on Image Processing, 2017
- Online supervised hashingComputer Vision and Image Understanding, 2017
- Supervised Matrix Factorization Hashing for Cross-Modal RetrievalIEEE Transactions on Image Processing, 2016
- Supervised Discrete Hashing2015
- Semantics-preserving hashing for cross-view retrieval2015
- Latent semantic sparse hashing for cross-modal similarity search2014
- Inter-media hashing for large-scale retrieval from heterogeneous data sources2013
- Effective Heterogeneous Similarity Measure with Nearest Neighbors for Cross-Media Retrieval2012
- NUS-WIDE2009
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004