INSTRE
Authors:
Open Access
- 5 February 2015
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 11 (3) , 1-21
Abstract
Over the last several decades, researches on visual object retrieval and recognition have achieved fast and remarkable success. However, while the category-level tasks prevail in the community, the instance-level tasks (especially recognition) have not yet received adequate focuses. Applications such as content-based search engine and robot vision systems have alerted the awareness to bring instance-level tasks into a more realistic and challenging scenario. Motivated by the limited scope of existing instance-level datasets, in this article we propose a new benchmark for INSTance-level visual object REtrieval and REcognition (INSTRE). Compared with existing datasets, INSTRE has the following major properties: (1) balanced data scale, (2) more diverse intraclass instance variations, (3) cluttered and less contextual backgrounds, (4) object localization annotation for each image, (5) well-manipulated double-labelled images for measuring multiple object (within one image) case. We will quantify and visualize the merits of INSTRE data, and extensively compare them against existing datasets. Then on INSTRE, we comprehensively evaluate several popular algorithms to large-scale object retrieval problem with multiple evaluation metrics. Experimental results show that all the methods suffer a performance drop on INSTRE, proving that this field still remains a challenging problem. Finally we integrate these algorithms into a simple yet efficient scheme for recognition and compare it with classification-based methods. Importantly, we introduce the realistic multiobjects recognition problem. All experiments are conducted in both single object case and multiple objects case.Keywords
Funding Information
- National Basic Research Program of China (2012CB316400)
- National Natural Science Foundation of China (61322212, and 61035001)
- Key Technologies R&D Program of China (2012BAH18B02)
- National Hi-Tech Development Program (863 Program) of China (2014AA015202)
- Lenovo Outstanding Young Scientists Program
This publication has 31 references indexed in Scilit:
- SIFT match verification by geometric coding for large-scale partial-duplicate web image searchACM Transactions on Multimedia Computing, Communications, and Applications, 2013
- Feature map hashing2010
- What Does Classifying More Than 10,000 Image Categories Tell Us?2010
- Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search2008
- LabelMe: A Database and Web-Based Tool for Image AnnotationInternational Journal of Computer Vision, 2007
- SURF: Speeded Up Robust Features2006
- Dataset Issues in Object Recognition2006
- The Amsterdam Library of Object ImagesInternational Journal of Computer Vision, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Random sample consensusCommunications of the ACM, 1981