VIOLENCE PREDICTION IN SURVEILLANCE VIDEOS
Open Access
- 30 September 2024
- journal article
- Published by Politechnika Lubelska in Applied Computer Science
- Vol. 20 (3) , 1-16
Abstract
Forecasting violence has become a critical obstacle in the field of video monitoring to guarantee public safety. Lately, YOLO (You Only Look Once) has become a popular and effective method for detecting weapons. However, identifying and forecasting violence remains a challenging endeavor. Additionally, the classification results had to be enhanced with semantic information. This study suggests a method for forecasting violent incidents by utilizing Yolov9 and ontology. The authors employed Yolov9 to identify and categorize weapons and individuals carrying them. Ontology is utilized for semantic prediction to assist in predicting violence. Semantic prediction happens through the application of a SPARQL query to the identified frame label. The authors developed a Threat Events Ontology (TEO) to gain semantic significance. The system was tested with a fresh dataset obtained from a variety of security cameras and websites. The VP Dataset comprises 8739 images categorized into 9 classes. The authors examined the outcomes of using Yolov9 in conjunction with ontology in comparison to using Yolov9 alone. The findings show that by combining Yolov9 with ontology, the violence prediction system's semantics and dependability are enhanced. The suggested system achieved a mean Average Precision (mAP) of 83.7 %, 88% for precision, and 76.4% for recall. However, the mAP of Yolov9 without TEO ontology achieved a score of 80.4%. It suggests that this method has a lot of potential for enhancing public safety. The authors finished all training and testing processes on Google Colab's GPU. That reduced the average duration by approximately 90.9%. The result of this work is a next level of object detectors that utilize ontology to improve the semantic significance for real-time end-to-end object detection.Keywords
This publication has 23 references indexed in Scilit:
- Weapon Detection in Surveillance Videos Using YOLOV8 and PELSF-DCNNE3S Web of Conferences, 2023
- YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors2023
- Weapon detection system for surveillance and security2023
- Cyber Crime Prediction Using Machine Learning2022
- Bridging the Gap Between Anchor-Based and Anchor-Free Detection via Adaptive Training Sample Selection2020
- CSPNet: A New Backbone that can Enhance Learning Capability of CNN2020
- Building Machine Learning and Deep Learning Models on Google Cloud Platform2019
- Focal Loss for Dense Object Detection2017
- YOLO9000: Better, Faster, Stronger2017
- You Only Look Once: Unified, Real-Time Object Detection2016