Deep semantic ranking based hashing for multi-label image retrieval
Authors:
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1556-1564
Abstract
With the rapid growth of web images, hashing has received increasing interests in large scale image retrieval. Research efforts have been devoted to learning compact binary codes that preserve semantic similarity based on labels. However, most of these hashing methods are designed to handle simple binary similarity. The complex multi-level semantic structure of images associated with multiple labels have not yet been well explored. Here we propose a deep semantic ranking based method for learning hash functions that preserve multilevel semantic similarity between multi-label images. In our approach, deep convolutional neural network is incorporated into hash functions to jointly learn feature representations and mappings from them to hash codes, which avoids the limitation of semantic representation power of hand-crafted features. Meanwhile, a ranking list that encodes the multilevel similarity information is employed to guide the learning of such deep hash functions. An effective scheme based on surrogate loss is used to solve the intractable optimization problem of nonsmooth and multivariate ranking measures involved in the learning procedure. Experimental results show the superiority of our proposed approach over several state-of-the-art hashing methods in term of ranking evaluation metrics when tested on multi-label image datasets.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Learning Fine-Grained Image Similarity with Deep Ranking2014
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Learning Hash Codes with Listwise Supervision2013
- Order preserving hashing for approximate nearest neighbor search2013
- Semi-supervised hashing for scalable image retrieval2010
- NUS-WIDE2009
- The MIR flickr retrieval evaluation2008
- Small codes and large image databases for recognition2008
- Optimizing search engines using clickthrough data2002
- Object recognition from local scale-invariant features1999