Multi-class object localization by combining local contextual interactions
Authors:
- 1 June 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 113-120
Abstract
Recent work in object localization has shown that the use of contextual cues can greatly improve accuracy over models that use appearance features alone. Although many of these models have successfully explored different types of contextual sources, they only consider one type of contextual interaction (e.g., pixel, region or object level interactions), leaving open questions about the true potential contribution of context. Furthermore, contributions across object classes and over appearance features still remain unknown. In this work, we introduce a novel model for multi-class object localization that incorporates different levels of contextual interactions. We study contextual interactions at pixel, region and object level by using three different sources of context: semantic, boundary support and contextual neighborhoods. Our framework learns a single similarity metric from multiple kernels, combining pixel and region interactions with appearance features, and then uses a conditional random field to incorporate object level interactions. We perform experiments on two challenging image databases: MSRC and PASCAL VOC 2007. Experimental results show that our model outperforms current state-of-the-art contextual frameworks and reveals individual contributions for each contextual interaction level, as well as the importance of each type of feature in object localization.Keywords
This publication has 23 references indexed in Scilit:
- Multiple kernels for object detection2009
- Attribute and simile classifiers for face verification2009
- Decomposing a scene into geometric and semantically consistent regions2009
- Context by region ancestry2009
- Semantic texton forests for image categorization and segmentation2008
- Support Kernel Machines for Object Recognition2007
- Learning The Discriminative Power-Invariance Trade-Off2007
- A hierarchical field framework for unified context-based classification2005
- Contextual Priming for Object DetectionInternational Journal of Computer Vision, 2003
- Using Local Context To Improve Face Detection2003