End-to-End Deep One-Class Learning for Anomaly Detection in UAV Video Stream
Open Access
- 19 May 2021
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 7 (5) , 90
Abstract
In recent years, the use of drones for surveillance tasks has been on the rise worldwide. However, in the context of anomaly detection, only normal events are available for the learning process. Therefore, the implementation of a generative learning method in an unsupervised mode to solve this problem becomes fundamental. In this context, we propose a new end-to-end architecture capable of generating optical flow images from original UAV images and extracting compact spatio-temporal characteristics for anomaly detection purposes. It is designed with a custom loss function as a sum of three terms, the reconstruction loss (), the generation loss () and the compactness loss () to ensure an efficient classification of the “deep-one” class. In addition, we propose to minimize the effect of UAV motion in video processing by applying background subtraction on optical flow images. We tested our method on very complex datasets called the mini-drone video dataset, and obtained results surpassing existing techniques’ performances with an AUC of 85.3.
Keywords
This publication has 33 references indexed in Scilit:
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Deep-Cascade: Cascading 3D Deep Neural Networks for Fast Anomaly Detection and Localization in Crowded ScenesIEEE Transactions on Image Processing, 2017
- Spatial–temporal convolutional neural networks for anomaly detection and localization in crowded scenesSignal Processing: Image Communication, 2016
- Deep Residual Learning for Image Recognition2016
- Learning Temporal Regularity in Video Sequences2016
- DeepFace: Closing the Gap to Human-Level Performance in Face Verification2014
- CNN Features Off-the-Shelf: An Astounding Baseline for Recognition2014
- DeepPose: Human Pose Estimation via Deep Neural Networks2014
- Online Dominant and Anomalous Behavior Detection in Videos2013
- A Multiple Instance Learning and Relevance Feedback Framework for Retrieving Abnormal Incidents in Surveillance VideosJournal of Multimedia, 2010