Real-Time Discriminative Background Subtraction
- 18 October 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 20 (5) , 1401-1414
Abstract
The authors examine the problem of segmenting foreground objects in live video when background scene textures change over time. In particular, we formulate background subtraction as minimizing a penalized instantaneous risk functional-yielding a local online discriminative algorithm that can quickly adapt to temporal changes. We analyze the algorithm's convergence, discuss its robustness to nonstationarity, and provide an efficient nonlinear extension via sparse kernels. To accommodate interactions among neighboring pixels, a global algorithm is then derived that explicitly distinguishes objects versus background using maximum a posteriori inference in a Markov random field (implemented via graph-cuts). By exploiting the parallel nature of the proposed algorithms, we develop an implementation that can run efficiently on the highly parallel graphics processing unit (GPU). Empirical studies on a wide variety of datasets demonstrate that the proposed approach achieves quality that is comparable to state-of-the-art offline methods, while still being suitable for real-time video analysis (≥ 75 fps on a mid-range GPU).Keywords
This publication has 37 references indexed in Scilit:
- Bilayer Segmentation of Live Video2006
- A Framework for Feature Selection for Background Subtraction2006
- Bayesian modeling of dynamic scenes for object detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Motion-based background subtraction using adaptive kernel density estimation2004
- Background modeling and subtraction of dynamic scenes2003
- Segmenting foreground objects from a dynamic textured background via a robust Kalman filter2003
- Tracking people with twists and exponential maps2002
- Learning patterns of activity using real-time trackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Wallflower: principles and practice of background maintenance1999
- CONDENSATION—Conditional Density Propagation for Visual TrackingInternational Journal of Computer Vision, 1998