Fast Discrete Collaborative Multi-Modal Hashing for Large-Scale Multimedia Retrieval
- 26 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 32 (11) , 2171-2184
Abstract
Many achievements have been made on learning to hash for uni-modal and cross-modal retrieval. However, it is still an unsolved problem that how to directly and efficiently learn discriminative discrete hash codes for the multimedia retrieval, where both query and database samples are represented with heterogeneous multi-modal features. With this motivation, we propose a Fast Discrete Collaborative Multi-modal Hashing (FDCMH) method in this paper. We first propose an efficient collaborative multi-modal mapping that first transforms heterogeneous multi-modal features into the unified factors to exploit the complementarity of multi-modal features and preserve the semantic correlations in multiple modalities with linear computation and space complexity. Such shared factors also bridge the heterogeneous modality gap and remove the inter-modality redundancy. Further, we develop an asymmetric hashing learning module to simultaneously correlate the learned hash codes with low-level data distribution and high-level semantics. In particular, this design could avoid the challenging symmetric semantic matrix factorization and $O (n^2s)$ memory cost ( $n$ is the number of training samples). It can support both computation and memory efficient discrete hash optimization. Experiments on several public multimedia retrieval datasets demonstrate the superiority of the proposed approach compared with state-of-the-art hashing techniques, in terms of both model learning efficiency and retrieval accuracy.
Keywords
Funding Information
- National Natural Science Foundation of China (61802236)
- Natural Science Foundation of Shandong Province (ZR2019QF002)
This publication has 43 references indexed in Scilit:
- Supervised Discrete Hashing2015
- Landmark Classification With Hierarchical Multi-Modal Exemplar FeatureIEEE Transactions on Multimedia, 2015
- Multiview Alignment Hashing for Efficient Image SearchIEEE Transactions on Image Processing, 2015
- Supervised hashing with latent factor models2014
- Multiple feature kernel hashing for large-scale visual searchPattern Recognition, 2014
- Inter-media hashing for large-scale retrieval from heterogeneous data sources2013
- Multi-view anchor graph hashing2013
- Composite hashing with multiple information sources2011
- NUS-WIDE2009
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004