Adversarial 3D Convolutional Auto-Encoder for Abnormal Event Detection in Videos
- 10 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 23 (15209210) , 3292-3305
Abstract
Abnormal event detection aims to identify the events that deviate from expected normal patterns. Existing methods usually extract normal spatio-temporal patterns of appearance and motion in a separate manner, which ignores low-level correlations between appearance and motion patterns and may fall short of capturing fine-grained spatio-temporal patterns. In this paper, we propose to simultaneously learn appearance and motion to obtain fine-grained spatio-temporal patterns. To this end, we present an adversarial 3D convolutional auto-encoder to learn the normal spatio-temporal patterns and then identify abnormal events by diverging them from the learned normal patterns in videos. The encoder captures the low-level correlations between spatial and temporal dimensions of videos, and generates distinctive features representing visual spatio-temporal information. The decoder reconstrucccts the original video from the encoded features representing by 3D de-convolutions and learns the normal spatio-temporal patterns in an unsupervised manner. We introduce the denoising reconstruction error and adversarial learning strategy to train the 3D convolutional auto-encoder to implicitly learn accurate data distributions that are considered normal patterns, which benefits enhancing the reconstruction ability of the auto-encoder to discriminate abnormal events. Both the theoretical analysis and the extensive experiments on four publicly available datasets demonstrate the effectiveness of our method.Keywords
Funding Information
- National Natural Science Foundation of China (61702037, 61773062)
This publication has 44 references indexed in Scilit:
- Spatial–temporal convolutional neural networks for anomaly detection and localization in crowded scenesSignal Processing: Image Communication, 2016
- Anomaly detection based on spatio-temporal sparse representation and visual attention analysisMultimedia Tools and Applications, 2016
- Abnormal Event Detection at 150 FPS in MATLAB2013
- Histograms of Optical Flow Orientation for Visual Abnormal Events Detection2012
- Sparse reconstruction cost for abnormal event detection2011
- Online detection of unusual events in videos via dynamic sparse coding2011
- Anomaly detectionACM Computing Surveys, 2009
- Robust Real-Time Unusual Event Detection using Multiple Fixed-Location MonitorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Semi-Supervised Adapted HMMs for Unusual Event Detection2005
- Jensen-Shannon divergence and Hilbert space embedding2004