Data-Driven Background Subtraction Algorithm for In-Camera Acceleration in Thermal Imagery
- 2 June 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 28 (9) , 2090-2104
Abstract
Detection of moving objects in videos is a crucial step toward successful surveillance and monitoring applications. A key component for such tasks is called background subtraction and tries to extract regions of interest from the image background for further processing or action. For this reason, its accuracy and real-time performance are of great significance. Although effective background subtraction methods have been proposed, only a few of them take into consideration the special characteristics of thermal imagery. In this paper, we propose a background subtraction scheme, which models the thermal responses of each pixel as a mixture of Gaussians with unknown number of components. Following a Bayesian approach, our method automatically estimates the mixture structure, while simultaneously it avoids over-/underfitting. The pixel density estimate is followed by an efficient and highly accurate updating mechanism, which permits our system to be automatically adapted to dynamically changing operation conditions. We propose a reference implementation of our method in reconfigurable hardware achieving both adequate performance and low-power consumption. Adopting a high-level synthesis design and demanding floating point arithmetic operations are mapped in reconfigurable hardware, demonstrating fast prototyping and on-field customization at the same time.Keywords
All Related Versions
Funding Information
- EU H2020 TERPSICHORE Project (691218)
- EU H2020 Stop-It Strategic, Tactical, Operational Protection of water Infrastructure against cyber-physical Threats, Project (740610)
This publication has 27 references indexed in Scilit:
- Generalized Stauffer–Grimson background subtraction for dynamic scenesMachine Vision and Applications, 2010
- An Embedded Real-Time Surveillance System: Implementation and EvaluationJournal of Signal Processing Systems, 2007
- Pedestrian detection and tracking in infrared imagery using shape and appearanceComputer Vision and Image Understanding, 2007
- Background-Subtraction in Thermal Imagery Using Contour SaliencyInternational Journal of Computer Vision, 2006
- Efficient adaptive density estimation per image pixel for the task of background subtractionPattern Recognition Letters, 2006
- Achieving real-time object detection and tracking under extreme conditionsJournal of Real-Time Image Processing, 2006
- A variational Bayesian mixture modelling framework for cluster analysis of gene-expression dataBioinformatics, 2005
- Probabilistic space-time video modeling via piecewise gmmIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Pfinder: real-time tracking of the human bodyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Adaptive MixturesJournal of the American Statistical Association, 1994