Video data mining using con .gurations of viewpoint invariant regions
Authors:
- J. SivicJSJ. Sivic
- A. ZissermanAZA. Zisserman
- 12 November 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 488-495
Abstract
We describe a method for obtaining the principal objects, characters and scenes in a video by measuring the reoccur- rence of spatial configurations of viewpoint invariant fea- tures. We investigate two aspects of the problem: the scale of the configurations, and the similarity requirements for clustering configurations. The problem is challenging firstly because an object can undergo substantial changes in imaged appearance throughout a video (due to viewpoint and illumination change, and partial occlusion), and secondly because con- figurations are detected imperfectly, so that inexact patterns must be matched. The novelty of the method is that viewpoint invariant fea- tures are used to form the configurations, and that efficient methods from the text analysis literature are employed to reduce the matching complexity. Examples of 'mined' objects are shown for a feature length film and a sitcom.Keywords
This publication has 17 references indexed in Scilit:
- Robust wide-baseline stereo from maximally stable extremal regionsImage and Vision Computing, 2004
- 3D object modeling and recognition using affine-invariant patches and multi-view spatial constraints2003
- Video Google: a text retrieval approach to object matching in videos2003
- Affine-invariant local descriptors and neighborhood statistics for texture recognition2003
- Object Recognition using Local Affine Frames on Distinguished Regions2002
- Constructing models for content-based image retrieval2001
- Indexing based on scale invariant interest points2001
- RELIABLE TRANSITION DETECTION IN VIDEOS: A SURVEY AND PRACTITIONER'S GUIDEInternational Journal of Image and Graphics, 2001
- Object recognition from local scale-invariant features1999
- Local grayvalue invariants for image retrievalIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997