Flip-Invariant SIFT for Copy and Object Detection
- 22 October 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 22 (3) , 980-991
Abstract
Scale-invariant feature transform (SIFT) feature has been widely accepted as an effective local keypoint descriptor for its invariance to rotation, scale, and lighting changes in images. However, it is also well known that SIFT, which is derived from directionally sensitive gradient fields, is not flip invariant. In real-world applications, flip or flip-like transformations are commonly observed in images due to artificial flipping, opposite capturing viewpoint, or symmetric patterns of objects. This paper proposes a new descriptor, named flip-invariant SIFT (or F-SIFT), that preserves the original properties of SIFT while being tolerant to flips. F-SIFT starts by estimating the dominant curl of a local patch and then geometrically normalizes the patch by flipping before the computation of SIFT. We demonstrate the power of F-SIFT on three tasks: large-scale video copy detection, object recognition, and detection. In copy detection, a framework, which smartly indices the flip properties of F-SIFT for rapid filtering and weak geometric checking, is proposed. F-SIFT not only significantly improves the detection accuracy of SIFT, but also leads to a more than 50% savings in computational cost. In object recognition, we demonstrate the superiority of F-SIFT in dealing with flip transformation by comparing it to seven other descriptors. In object detection, we further show the ability of F-SIFT in describing symmetric objects. Consistent improvement across different kinds of keypoint detectors is observed for F-SIFT over the original SIFT.Keywords
This publication has 19 references indexed in Scilit:
- FIND: A Neat Flip Invariant Descriptor2010
- MI-SIFT2010
- What Does Classifying More Than 10,000 Image Categories Tell Us?2010
- A compact, effective descriptor for video copy detection2009
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Evaluation campaigns and TRECVid2006
- A performance evaluation of local descriptorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- A sparse texture representation using local affine regionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Scale & Affine Invariant Interest Point DetectorsInternational Journal of Computer Vision, 2004
- Feature Detection with Automatic Scale SelectionInternational Journal of Computer Vision, 1998