Learning From Interaction-Enhanced Scene Graph for Pedestrian Collision Risk Assessment
- 28 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 8 (9) , 4237-4248
Abstract
Collision risk assessment aims to provide a sub-jective cognitive comprehension of the risk level in driving scenarios, which is critical for the safety of autonomous driving systems. Pedestrian crossing scenarios contain intricate human-vehicle interactions. Hence, it is important to capture the rich relations between traffic entities and to assess the collision risk promptly to ensure safety. Existing studies focus on modeling the spatial relationships between the ego-vehicle and other vehicles in typical traffic scenarios, while ignoring the complex interactions between pedestrians and the ego-vehicle in critical driving scenarios. To address this issue, we propose a novel approach that involves constructing traffic scene graphs with enhanced vehicle-pedestrian interactions, along with introducing an innovative deep model built upon Transformer and GCN for pedestrian collision risk assessment. Specifically, to facilitate spatio-temporal modeling of traffic scene graph sequence, we propose a novel unified framework that integrates Multi-Relation Graph Convolution Network (MR-GCN) and Temporal Trans-former Encoder. In addition, two variants of traffic scene graph datasets termed as Interaction-Enhanced Scene Graph (IESG) and None-Interaction-Enhanced Scene Graph (Non-IESG) are created for the purpose of assessing pedestrian collision risk, utilizing the CAP-DATA and JAAD respectively. Experiments are conducted on our newly created traffic scene graph datasets of pedestrian crossing scenes. The results on the IESG dataset show that our model outperforms the baseline model with higher accuracy (94% vs. 84%), higher AUC (98% vs. 89%), and higher F1-score (93% vs. 84%). IESG and Non-IESG datasets are available at https://github.com/Pedestrian-Crossing-Collision-Risk-Assessment-Datasets .Keywords
Funding Information
- National Natural Science Foundation of China (62373387)
- Natural Science Foundation of Guangdong Province (2023A1515030264)
This publication has 50 references indexed in Scilit:
- Modeling Relational Data with Graph Convolutional Networks2018
- Infrastructure-cooperative algorithm for effective intersection collision avoidanceTransportation Research Part C: Emerging Technologies, 2018
- Understanding Pedestrian Behavior in Complex Traffic ScenesIEEE Transactions on Intelligent Vehicles, 2017
- Identification and Analysis of Driver Postures for In-Vehicle Driving Activities and Secondary Tasks RecognitionIEEE Transactions on Computational Social Systems, 2017
- Vehicle collision prediction at intersections based on comparison of minimal distance between vehicles and dynamic thresholdsIET Intelligent Transport Systems, 2017
- Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior2017
- A joint cascaded framework for simultaneous eye detection and eye state estimationPattern Recognition, 2017
- Scene Graph Generation by Iterative Message Passing2017
- Image retrieval using scene graphs2015
- A survey on motion prediction and risk assessment for intelligent vehiclesROBOMECH Journal, 2014