Super-Trajectory for Video Segmentation
Authors:
- Wenguan WangWWWenguan Wang
- Jianbing ShenJSJianbing Shen
- Jianwen XieJXJianwen Xie
- Fatih PorikliFPFatih Porikli
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1680-1688
Abstract
We introduce a novel semi-supervised video segmentation approach based on an efficient video representation, called as “super-trajectory”. Each super-trajectory corresponds to a group of compact trajectories that exhibit consistent motion patterns, similar appearance and close spatiotemporal relationships. We generate trajectories using a probabilistic model, which handles occlusions and drifts in a robust and natural way. To reliably group trajectories, we adopt a modified version of the density peaks based clustering algorithm that allows capturing rich spatiotemporal relations among trajectories in the clustering process. The presented video representation is discriminative enough to accurately propagate the initial annotations in the first frame onto the remaining video frames. Extensive experimental analysis on challenging benchmarks demonstrate our method is capable of distinguishing the target objects from complex backgrounds and even reidentifying them after occlusions.Keywords
All Related Versions
This publication has 42 references indexed in Scilit:
- Consistent Video Saliency Using Local Gradient Flow Optimization and Global RefinementIEEE Transactions on Image Processing, 2015
- Robust Video Object CosegmentationIEEE Transactions on Image Processing, 2015
- Clustering by fast search and find of density peaksScience, 2014
- SeamSeg: Video Object Segmentation Using Patch Seams2014
- Segmentation of Moving Objects by Long Term Video AnalysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Discontinuity-aware video object cutoutACM Transactions on Graphics, 2012
- Active Frame Selection for Label Propagation in Videos2012
- Two-Granularity Tracking: Mediating Trajectory and Detection Graphs for Tracking under Occlusions2012
- Multiple Hypothesis Video Segmentation from Superpixel Flows2010
- Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow2010