Modeling Background and Segmenting Moving Objects from Compressed Video
Authors:
- Jie YangJYJie Yang
- Wen GaoWGWen Gao
- 25 April 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 18 (5) , 670-681
Abstract
Modeling background and segmenting moving objects are significant techniques for video surveillance and other video processing applications. Most existing methods of modeling background and segmenting moving objects mainly operate in the spatial domain at pixel level. In this paper, we present three new algorithms (running average, median, mixture of Gaussians) modeling background directly from compressed video, and a two-stage segmentation approach based on the proposed background models. The proposed methods utilize discrete cosine transform (DCT) coefficients (including ac coefficients) at block level to represent background, and adapt the background by updating DCT coefficients. The proposed segmentation approach can extract foreground objects with pixel accuracy through a two-stage process. First a new background subtraction technique in the DCT domain is exploited to identify the block regions fully or partially occupied by foreground objects, and then pixels from these foreground blocks are further classified in the spatial domain. The experimental results show the proposed background modeling algorithms can achieve comparable accuracy to their counterparts in the spatial domain, and the associated segmentation scheme can visually generate good segmentation results with efficient computation. For instance, the computational cost of the proposed median and MoG algorithms are only 40.4% and 20.6% of their counterparts in the spatial domain for background construction.Keywords
This publication has 24 references indexed in Scilit:
- A consensus-based method for tracking: Modelling background scenario and foreground appearancePattern Recognition, 2007
- Video Object Segmentation: A Compressed Domain ApproachIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Detecting moving objects, ghosts, and shadows in video streamsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Video segmentation by MAP labeling of watershed segmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- A Bayesian computer vision system for modeling human interactionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Region-based representations of image and video: segmentation tools for multimedia servicesIEEE Transactions on Circuits and Systems for Video Technology, 1999
- Unsupervised video segmentation based on watersheds and temporal trackingIEEE Transactions on Circuits and Systems for Video Technology, 1998
- Automatic segmentation of moving objects for video object plane generationIEEE Transactions on Circuits and Systems for Video Technology, 1998
- Pfinder: real-time tracking of the human bodyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Segmentation and tracking of piglets in imagesMachine Vision and Applications, 1995