Background Segmentation Using Spatial-Temporal Multi-Resolution MRF
Authors:
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 8-13
Abstract
Robust and accurate background segmentation is crucial for surveillance applications and is a key element in visual tracking, layer-based compression, and silhouette-based 3D reconstruction. In this paper, we present a novel spatial-temporal model that describes the appearance and dynamics of background scenes at multiple resolutions. We propose a time-dependent Markov Random Field (MRF) to represent the state of foreground and background at each pixel in the spatial-temporal pyramid. Pixels are linked spatially and temporally across frames. The probability of adding/deleting a foreground object is calculated by online learning algorithm and is used as prior information in computing foreground label. We use Gibbs Sampling to solve the MRF in a Maximum A Posterior (MAP) framework. Experimental results show that this real-time algorithm is able to segment the foreground object accurately from videos and more resilient to distractions such as imaging noise, illumination changes, camera shakes, and random motion in the scene.Keywords
This publication has 12 references indexed in Scilit:
- Adaptive background mixture models for real-time tracking2003
- Using adaptive tracking to classify and monitor activities in a site2002
- Topology free hidden Markov models: application to background modeling2002
- A Bayesian computer vision system for modeling human interactionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- A Probabilistic Background Model for Tracking2000
- W/sup 4/: real-time surveillance of people and their activitiesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- An Introduction to Variational Methods for Graphical Models1998
- Bayesian Data Analysis1995
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of ImagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1984