Block-Sparse RPCA for Salient Motion Detection
Authors:
- 1 April 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 36 (10) , 1975-1987
Abstract
Recent evaluation [2], [13] of representative background subtraction techniques demonstrated that there are still considerable challenges facing these methods. Challenges in realistic environment include illumination change causing complex intensity variation, background motions (trees, waves, etc.) whose magnitude can be greater than those of the foreground, poor image quality under low light, camouflage, etc. Existing methods often handle only part of these challenges; we address all these challenges in a unified framework which makes little specific assumption of the background. We regard the observed image sequence as being made up of the sum of a low-rank background matrix and a sparse outlier matrix and solve the decomposition using the Robust Principal Component Analysis method. Our contribution lies in dynamically estimating the support of the foreground regions via a motion saliency estimation step, so as to impose spatial coherence on these regions. Unlike smoothness constraint such as MRF, our method is able to obtain crisply defined foreground regions, and in general, handles large dynamic background motion much better. Furthermore, we also introduce an image alignment step to handle camera jitter. Extensive experiments on benchmark and additional challenging data sets demonstrate that our method works effectively on a wide range of complex scenarios, resulting in best performance that significantly outperforms many state-of-the-art approaches.Keywords
Funding Information
- theory and methods of digital conservation for cultural heritage (2012CB725300)
This publication has 25 references indexed in Scilit:
- Splitting Gaussians in Mixture Models2012
- Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Secrets of optical flow estimation and their principles2010
- Dense error correction for low-rank matrices via Principal Component Pursuit2010
- Sparse Representation for Computer Vision and Pattern RecognitionProceedings of the IEEE, 2010
- Robust Face Recognition via Sparse RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Efficient adaptive density estimation per image pixel for the task of background subtractionPattern Recognition Letters, 2006
- Extracting Roadway Background Image: Mode-Based ApproachTransportation Research Record: Journal of the Transportation Research Board, 2006
- A maximality principle applied to a contrario motion detection2005
- Detecting salient motion by accumulating directionally-consistent flowIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000