]Video object segmentation by hypergraph cut
Authors:
- 1 June 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1738-1745
Abstract
In this paper, we present a new framework of video object segmentation, in which we formulate the task of extracting prominent objects from a scene as the problem of hypergraph cut. We initially over-segment each frame in the sequence, and take the over-segmented image patches as the vertices in the graph. Different from the traditional pairwise graph structure, we build a novel graph structure, hypergraph, to represent the complex spatio-temporal neighborhood relationship among the patches. We assign each patch with several attributes that are computed from the optical flow and the appearance-based motion profile, and the vertices with the same attribute value is connected by a hyperedge. Through all the hyperedges, not only the complex non-pairwise relationships between the patches are described, but also their merits are integrated together organically. The task of video object segmentation is equivalent to the hypergraph partition, which can be solved by the hypergraph cut algorithm. The effectiveness of the proposed method is demonstrated by extensive experiments on nature scenes.Keywords
This publication has 12 references indexed in Scilit:
- Learning to Find Object Boundaries Using Motion Cues2007
- Spectral Segmentation with Multiscale Graph Decomposition2005
- Beyond Pairwise Clustering2005
- The Local Projective Shape of Smooth Surfaces and Their OutlinesInternational Journal of Computer Vision, 2005
- Integrating Region and Boundary Information for Improved Spatial Coherencein Object Tracking2005
- Curve and Surface Duals and the Recognition of Curved 3D Objects from their SilhouettesInternational Journal of Computer Vision, 2004
- Layered motion segmentation and depth ordering by tracking edgesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Segmentation using eigenvectors: a unifying view1999
- Using extremal boundaries for 3-D object modelingIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992