Efficient Spatio-temporal Segmentation for Extracting Moving Objects in Video Sequences
Authors:
- Renjie LiRLRenjie Li
- Songyu YuSYSongyu Yu
- Xiaokang YangXYXiaokang Yang
- 8 October 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 53 (3) , 1161-1167
Abstract
Extraction of moving objects is an important and fundamental research topic for many digital video applications. This paper addresses an efficient spatio-temporal segmentation scheme to extract moving objects from video sequences. The temporal segmentation yields a temporal mask that indicates moving regions and static regions for each frame. For localization of moving objects, a block-based motion detection method considering a novel feature measure is proposed to detect changed regions. These changed regions are coarse and need accurate spatial compensation. An edge-based morphological dilation method is presented to achieve the anisotropic expansion of the changed regions. Furthermore, to solve the temporarily stopping problem of moving objects, the inertia information of moving objects is considered in the temporal segmentation. The spatial segmentation based on the watershed algorithm is performed to provide homogeneous regions with closed and precise boundaries. It considers the global information to improve the accuracy of the boundaries. To reduce over-segmentation in the watershed segmentation, a novel mean filter is proposed to suppress some minima. A fusion of the spatial and temporal segmentation results produces complete moving objects faithfully. Compared with the reference algorithms, the fusion threshold in our scheme is fixed for different sequences. Experiments on typical sequences have successfully demonstrated the validity of the proposed scheme.Keywords
This publication has 12 references indexed in Scilit:
- Multi-frame simultaneous motion estimation and segmentationIEEE Transactions on Consumer Electronics, 2005
- Semantic spatio-temporal segmentation for extracting video objects2003
- Region tracking through image sequences2002
- Automatic segmentation of moving objects in video sequences: a region labeling approachIEEE Transactions on Circuits and Systems for Video Technology, 2002
- Improved techniques for automatic image segmentationIEEE Transactions on Circuits and Systems for Video Technology, 2001
- A VOP generation tool: automatic segmentation of moving objects in image sequences based on spatio-temporal informationIEEE Transactions on Circuits and Systems for Video Technology, 1999
- Video segmentation based on watershed algorithm and optical flow motion estimation1999
- Nonlinear Digital Filters1990
- Image Analysis Using Mathematical MorphologyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1987
- A survey of edge detection techniquesComputer Graphics and Image Processing, 1975