A Unified Video Segmentation Benchmark: Annotation, Metrics and Analysis
Authors:
- Fabio GalassoFGFabio Galasso
- Naveen Shankar NagarajaNNNaveen Shankar Nagaraja
- Tatiana Jimenez CardenasTCTatiana Jimenez Cardenas
- Thomas BroxTBThomas Brox
- Bernt SchieleBSBernt Schiele
- 1 December 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15505499,p. 3527-3534
Abstract
Video segmentation research is currently limited by the lack of a benchmark dataset that covers the large variety of sub problems appearing in video segmentation and that is large enough to avoid over fitting. Consequently, there is little analysis of video segmentation which generalizes across subtasks, and it is not yet clear which and how video segmentation should leverage the information from the still-frames, as previously studied in image segmentation, alongside video specific information, such as temporal volume, motion and occlusion. In this work we provide such an analysis based on annotations of a large video dataset, where each video is manually segmented by multiple persons. Moreover, we introduce a new volume-based metric that includes the important aspect of temporal consistency, that can deal with segmentation hierarchies, and that reflects the tradeoff between over-segmentation and segmentation accuracy.Keywords
This publication has 15 references indexed in Scilit:
- Object segmentation in video: A hierarchical variational approach for turning point trajectories into dense regions2011
- Spatio-temporal clustering of probabilistic region trajectories2011
- Track to the future: Spatio-temporal video segmentation with long-range motion cues2011
- Occlusion boundary detection and figure/ground assignment from optical flow2011
- Efficient hierarchical graph-based video segmentation2010
- Semantic object classes in video: A high-definition ground truth databasePattern Recognition Letters, 2009
- A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms2007
- Toward Objective Evaluation of Image Segmentation AlgorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Learning to Find Object Boundaries Using Motion Cues2007
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics2002