QuARCS: Quantum Anomaly Recognition and Caption Scoring Framework for Surveillance Videos
- 7 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 70 (3) , 5618-5627
Abstract
Traditional surveillance video stream monitoring demands manual analysis, often leading to inaccuracies. While recent advancements have enabled automated analysis in surveillance video stream monitoring, challenges persist in achieving high accuracy and efficiency. Thus, an automated system is needed to monitor and report on video streams in real-time or retrospectively within surveillance networks, alleviating human error and inefficiency. Our paper, presents a comprehensive framework that integrates a hybrid quantum-classical anomaly detection system, a caption-generating model, and a novel Text-Driven Urgency Rating Model (T-DURM) trained using a newly created labelled dataset called UCFC-CUR which prioritises crimes based on their urgency. The hybrid classifier outperforms its direct classical counterpart by 7.7%. The aforementioned pipeline possesses the capability to identify anomalous occurrences from surveillance videos, generate a textual representation of the event, and assign a numerical value indicating the level of urgency associated with the specific anomaly. The hybrid anomaly detection model achieved an AUC of 82.80 surpassing the classical model’s AUC of 75.14. While the newly proposed T-DRUM achieves a R2 score of 0.982.Keywords
This publication has 37 references indexed in Scilit:
- Video captioning: A comparative review of where we are and which could be the routeComputer Vision and Image Understanding, 2023
- Thinking Hallucination for Video Captioning2023
- Effect of data encoding on the expressive power of variational quantum-machine-learning modelsPhysical Review A, 2021
- Anomaly recognition from surveillance videos using 3D convolution neural networkMultimedia Tools and Applications, 2021
- The global landscape of AI ethics guidelinesNature Machine Intelligence, 2019
- Supervised learning with quantum-enhanced feature spacesNature, 2019
- Quantum Machine Learning in Feature Hilbert SpacesPhysical Review Letters, 2019
- AI can be sexist and racist — it’s time to make it fairNature, 2018
- Video anomaly detection based on local statistical aggregates2012
- Content-based video sequence interpretationIEEE Transactions on Consumer Electronics, 2001