Violent Physical Behavior Detection using 3D Spatio-Temporal Convolutional Neural Networks
Authors:
- Zhaosheng XuZXZhaosheng Xu
Open Access
- 1 January 2023
- journal article
- research article
- Published by The Science and Information Organization in International Journal of Advanced Computer Science and Applications
- Vol. 14 (8)
Abstract
The use of surveillance cameras has made it possible to analyze a huge amount of data for automated surveillance. The use of security systems in schools, hotels, hospitals, and other security areas is required to identify the violent activities that can cause social, economic, and environmental damage. Detecting the mobile objects on each frame is a fundamental phase in the analysis of the video trail and the violence recognition. Therefore, a three-step approach is presented in this article. In our method, the separation of the frames containing the motion information and the detection of the violent behavior are applied at two levels of the network. First, the people in the video frames are identified by using a convolutional neural network. In the second step, a sequence of 16 frames containing the identified people is injected into the 3D CNN. Furthermore, we optimize the 3D CNN by using the visual inference and then a neural network optimization tool that transforms the pre-trained model into an average representation. Finally, this method uses the toolbox of OPENVINO to perform the optimization operations to increase the performance. To evaluate the accuracy of our algorithm, two datasets have been analyzed, which are: Violence in Movies and Hockey Fight. The results show that the final accuracy of this analysis is equal to 99.9% and 96% from each dataset.Keywords
This publication has 16 references indexed in Scilit:
- Efficient CNN based summarization of surveillance videos for resource-constrained devicesPattern Recognition Letters, 2020
- Detection and localization of crowd behavior using a novel tracklet-based modelInternational Journal of Machine Learning and Cybernetics, 2017
- Temporal Segment Networks: Towards Good Practices for Deep Action Recognition2016
- Human violence recognition and detection in surveillance videos2016
- Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs2016
- Violence detection using Oriented VIolent FlowsImage and Vision Computing, 2016
- Pooled motion features for first-person videos2015
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Measuring the crime displacement and diffusion of benefit effects of open-street CCTV in South KoreaInternational Journal of Law, Crime and Justice, 2012
- Violence Detection in Video Using Computer Vision Techniques2011