Unsupervised learning of high-order structural semantics from images
- 1 September 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15505499,p. 2122-2129
Abstract
Structural semantics are fundamental to understanding both natural and man-made objects from languages to buildings. They are manifested as repeated structures or patterns and are often captured in images. Finding repeated patterns in images, therefore, has important applications in scene understanding, 3D reconstruction, and image retrieval as well as image compression. Previous approaches in visual-pattern mining limited themselves by looking for frequently co-occurring features within a small neighborhood in an image. However, semantics of a visual pattern are typically defined by specific spatial relationships between features regardless of the spatial proximity. In this paper, semantics are represented as visual elements and geometric relationships between them. A novel unsupervised learning algorithm finds pair-wise associations of visual elements that have consistent geometric relationships sufficiently often. The algorithms are efficient - maximal matchings are determined without combinatorial search. High-order structural semantics are extracted by mining patterns that are composed of pairwise spatially consistent associations of visual elements. We demonstrate the effectiveness of our approach for discovering repeated visual patterns on a variety of image collections.Keywords
This publication has 19 references indexed in Scilit:
- Factoring repeated content within and among imagesACM Transactions on Graphics, 2008
- Discovering structural regularity in 3D geometryACM Transactions on Graphics, 2008
- SpaRClus: Spatial Relationship Pattern-Based Hierarchical Clustering2008
- Object retrieval with large vocabularies and fast spatial matching2007
- Scalable Recognition with a Vocabulary Tree2006
- Finding Frequent Patterns in a Large Sparse Graph*Data Mining and Knowledge Discovery, 2005
- Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Noncombinatorial detection of regular repetitions under perspective skewIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Video Google: a text retrieval approach to object matching in videos2003