Attention Model Based SIFT Keypoints Filtration for Image Retrieval
Authors:
- Ke GaoKGKe Gao
- Shouxun LinSLShouxun Lin
- Yongdong ZhangYZYongdong Zhang
- Sheng TangSTSheng Tang
- Huamin RenHRHuamin Ren
- 1 May 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 191-196
Abstract
Effective feature extraction is a fundamental component of content-based image retrieval. Scale Invariant Feature Transform (SIFT) has been proven to be the most robust local invariant feature descriptor. However, SIFT algorithm generates hundreds of thousands of keypoints per image, and most of them comes from background. This has seriously affected the application of SIFT in real-time image retrieval. This paper addresses this problem and proposes a novel method to filter the SIFT keypoints using attention model. Based on visual attention analysis, all of the keypoints in an image are ranked with their attention saliency, and only the most distinctive keypoints will be reserved. Then we use Bag of words to efficiently index these features. Experiments demonstrate that the attention model based SIFT keypoints filtration algorithm provides significant benefits both in retrieval accuracy and matching speed.Keywords
This publication has 8 references indexed in Scilit:
- CSIFT: A SIFT Descriptor with Color Invariant Characteristics2006
- A performance evaluation of local descriptorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Matching Widely Separated Views Based on Affine Invariant RegionsInternational Journal of Computer Vision, 2004
- Contrast-based image attention analysis by using fuzzy growing2003
- Video Google: a text retrieval approach to object matching in videos2003
- Visual attention and target detection in cluttered natural scenesOptical Engineering, 2001
- Modeling visual attention via selective tuningArtificial Intelligence, 1995