Moving Object Detection in Video via Hierarchical Modeling and Alternating Optimization
- 22 November 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 28 (4) , 2021-2036
Abstract
In conventional wisdom of video modeling, background is often treated as the primary target and foreground is derived using the technique of background subtraction. Based on the observation that foreground and background are two sides of the same coin, we propose to treat them as peer unknown variables and formulate a joint estimation problem, called Hierarchical modeling and Alternating Optimization (HMAO). The motivation behind our hierarchical extensions of background and foreground models is to better incorporate a priori knowledge about the disparity between background and foreground. For background, we decompose it into temporally low-frequency and high-frequency components for the purpose of better characterizing the class of video with dynamic background; for foreground, we construct a Markov random field prior at a spatially low resolution as the pivot to facilitate noise-resilient refinement at higher resolutions. Built on hierarchical extensions of both models, we show how to successively refine their joint estimates under a unified framework known as alternating direction multipliers method. Experimental results have shown that our approach produces more discriminative background and demonstrates better robustness to noise than other competing methods. When compared against current state-of-the-art techniques, HMAO achieves at least comparable and often superior performance in terms of F-measure scores especially for video containing dynamic and complex background.Keywords
Funding Information
- National Natural Science Foundation of China (61732011, 61432011, U1435212, 61502332)
- Applied Foundamental Research Program of Qinghai Province (2019-ZJ-7017)
This publication has 50 references indexed in Scilit:
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Robust principal component analysis?Journal of the ACM, 2011
- Background Subtraction via Robust Dictionary LearningEURASIP Journal on Image and Video Processing, 2011
- Tensor Decompositions and ApplicationsSIAM Review, 2009
- A consensus-based method for tracking: Modelling background scenario and foreground appearancePattern Recognition, 2007
- Efficient adaptive density estimation per image pixel for the task of background subtractionPattern Recognition Letters, 2006
- Statistical Modeling of Complex Backgrounds for Foreground Object DetectionIEEE Transactions on Image Processing, 2004
- Fast approximate energy minimization via graph cutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- A Bayesian computer vision system for modeling human interactionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Pfinder: real-time tracking of the human bodyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997