A Comparative Study of Transfer Learning Approaches for Video Anomaly Detection
- 9 December 2020
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 35 (05)
Abstract
Recent research has shown that features obtained from pretrained Convolutional Neural Network (CNN) models can be promptly applied to a variety of problems they were not originally designed to solve. This concept, often referred to as Transfer Learning (TL), is a common practice when labeled data is limited. In some fields, such as video anomaly detection, TL is still an underexplored subject in the sense that it is not clear whether the architecture of the pretrained CNN model impacts on the video anomaly detection performance. In order to clarify this issue, we perform an extensive benchmark using 12 different pretrained CNN models on ImageNet as feature extractors and apply the features obtained to seven video anomaly detection benchmark datasets. This work presents some interesting findings about video anomaly detection using TL. The highlights of our findings were revealed by our experiments, which have shown that a simple classification process using One-Class Support Vector Machines yields similar results to state-of-the-art models. Moreover, a statistical analysis suggests that architectural differences are negligible when choosing a pretrained model for video anomaly detection, since all models presented similar performance. At last, we present an in-depth visual analysis of the Avenue dataset, and reveal several aspects that may be limiting the performance of state-of-the-art video anomaly detection methods.Keywords
Funding Information
- CNPq for the scholarship (141983/2018-3)
- CNPq for the research (440977/2015-0)
This publication has 22 references indexed in Scilit:
- Interactive deep learning method for segmenting moving objectsPattern Recognition Letters, 2017
- Transfer learning using computational intelligence: A surveyKnowledge-Based Systems, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Video anomaly detection based on a hierarchical activity discovery within spatio-temporal contextsNeurocomputing, 2014
- Crowded Scene Analysis: A SurveyIEEE Transactions on Circuits and Systems for Video Technology, 2014
- Transfer Learning for Visual Categorization: A SurveyIEEE Transactions on Neural Networks and Learning Systems, 2014
- Abnormal Event Detection at 150 FPS in MATLAB2013
- Video anomaly detection based on local statistical aggregates2012
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of VarianceJournal of the American Statistical Association, 1937