BatchNorm-Based Weakly Supervised Video Anomaly Detection
- 27 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (12) , 13642-13654
Abstract
In weakly supervised video anomaly detection (WVAD), where only video-level labels indicating the presence or absence of abnormal events are available, the primary challenge arises from the inherent ambiguity in temporal annotations of abnormal occurrences. Inspired by the statistical insight that temporal features of abnormal events often exhibit outlier characteristics, we propose a novel method, BN-WVAD, which incorporates BatchNorm into WVAD. In the proposed BN-WVAD, we leverage the Divergence of Feature from the Mean vector (DFM) of BatchNorm as a reliable abnormality criterion to discern potential abnormal snippets in abnormal videos. The proposed DFM criterion is also discriminative for anomaly recognition and more resilient to label noise, serving as the additional anomaly score to amend the prediction of the anomaly classifier that is susceptible to noisy labels. Moreover, a batch-level selection strategy is devised to filter more abnormal snippets in videos where more abnormal events occur. The proposed BN-WVAD model demonstrates state-of-the-art performance on UCF-Crime with an AUC of 87.24%, and XD-Violence, where AP reaches up to 84.93%. Our code implementation is accessible at https://github.com/cool-xuan/BN-WVAD.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62072080, 62222203, 62476201)
- New Cornerstone Science Foundation
- XPLORER PRIZE
This publication has 46 references indexed in Scilit:
- Self-supervised Sparse Representation for Video Anomaly Detection2022
- CLAWS: Clustering Assisted Weakly Supervised Learning with Normalcy Suppression for Anomalous Event Detection2020
- Not only Look, But Also Listen: Learning Multimodal Violence Detection Under Weak Supervision2020
- Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017
- Aggregated Residual Transformations for Deep Neural Networks2017
- Multiple instance learning for soft bags via top instances2015
- Abnormal crowd behavior detection using social force model2009
- The Mahalanobis distanceChemometrics and Intelligent Laboratory Systems, 2000
- Exponential smoothing: The state of the artJournal of Forecasting, 1985
- A CENTRAL LIMIT THEOREM AND A STRONG MIXING CONDITIONProceedings of the National Academy of Sciences, 1956