Cross-Modality Binary Code Learning via Fusion Similarity Hashing
Authors:
- Hong LiuHLHong Liu
- Rongrong JiRJRongrong Ji
- Yongjian WuYWYongjian Wu
- Feiyue HuangFHFeiyue Huang
- Baochang ZhangBZBaochang Zhang
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 6345-6353
Abstract
Binary code learning has been emerging topic in large-scale cross-modality retrieval recently. It aims to map features from multiple modalities into a common Hamming space, where the cross-modality similarity can be approximated efficiently via Hamming distance. To this end, most existing works learn binary codes directly from data instances in multiple modalities, which preserve both intra-and inter-modal similarities respectively. Few methods consider to preserve the fusion similarity among multi-modal instances instead, which can explicitly capture their heterogeneous correlation in cross-modality retrieval. In this paper, we propose a hashing scheme, termed Fusion Similarity Hashing (FSH), which explicitly embeds the graph-based fusion similarity across modalities into a common Hamming space. Inspired by the fusion by diffusion, our core idea is to construct an undirected asymmetric graph to model the fusion similarity among different modalities, upon which a graph hashing scheme with alternating optimization is introduced to learn binary codes that embeds such fusion similarity. Quantitative evaluations on three widely used benchmarks, i.e., UCI Handwritten Digit, MIR-Flickr25K and NUS-WIDE, demonstrate that the proposed FSH approach can achieve superior performance over the state-of-the-art methods.Keywords
This publication has 18 references indexed in Scilit:
- Large-Scale Cross-Modality Search via Collective Matrix Factorization HashingIEEE Transactions on Image Processing, 2016
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis2015
- Alternating Co-Quantization for Cross-Modal Hashing2015
- Semantics-preserving hashing for cross-view retrieval2015
- Latent semantic sparse hashing for cross-modal similarity search2014
- Packing and Padding: Coupled Multi-index for Accurate Image Retrieval2014
- Heterogeneous Image Features Integration via Multi-modal Semi-supervised Learning Model2013
- Linear cross-modal hashing for efficient multimedia search2013
- On the Role of Correlation and Abstraction in Cross-Modal Multimedia RetrievalIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004