A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidents
Authors:
- Muhammad Monjurul KarimMKMuhammad Monjurul Karim
- Yu LiYLYu Li
- Ruwen QinRQRuwen Qin
- Zhaozheng YinZYZhaozheng Yin
Preprint
Abstract
The rapid advancement of sensor technologies and artificial intelligence are creating new opportunities for traffic safety enhancement. Dashboard cameras (dashcams) have been widely deployed on both human driving vehicles and automated driving vehicles. A computational intelligence model that can accurately and promptly predict accidents from the dashcam video will enhance the preparedness for accident prevention. The spatial-temporal interaction of traffic agents is complex. Visual cues for predicting a future accident are embedded deeply in dashcam video data. Therefore, the early anticipation of traffic accidents remains a challenge. Inspired by the attention behavior of humans in visually perceiving accident risks, this paper proposes a Dynamic Spatial-Temporal Attention (DSTA) network for the early accident anticipation from dashcam videos. The DSTA-network learns to select discriminative temporal segments of a video sequence with a Dynamic Temporal Attention (DTA) module. It also learns to focus on the informative spatial regions of frames with a Dynamic Spatial Attention (DSA) module. A Gated Recurrent Unit (GRU) is trained jointly with the attention modules to predict the probability of a future accident. The evaluation of the DSTA-network on two benchmark datasets confirms that it has exceeded the state-of-the-art performance. A thorough ablation study that assesses the DSTA-network at the component level reveals how the network achieves such performance. Furthermore, this paper proposes a method to fuse the prediction scores from two complementary models and verifies its effectiveness in further boosting the performance of early accident anticipation.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Crash report data analysis for creating scenario-wise, spatio-temporal attention guidance to support computer vision-based perception of fatal crash risksAccident Analysis & Prevention, 2021
- A Dynamic Spatial-Temporal Attention-Based GRU Model With Healthy Features for State-of-Health Estimation of Lithium-Ion BatteriesIEEE Access, 2021
- Deep Learning for Safe Autonomous Driving: Current Challenges and Future DirectionsIEEE Transactions on Intelligent Transportation Systems, 2020
- Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art2020
- Research Advances and Challenges of Autonomous and Connected Ground VehiclesIEEE Transactions on Intelligent Transportation Systems, 2019
- Pedestrian Path, Pose, and Intention Prediction Through Gaussian Process Dynamical Models and Pedestrian Activity RecognitionIEEE Transactions on Intelligent Transportation Systems, 2018
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Anticipating Human Activities Using Object Affordances for Reactive Robotic ResponseIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015