Egocentric Vulnerable Road Users Trajectory Prediction With Incomplete Observation
- 25 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (10) , 13694-13705
Abstract
Vulnerable Road Users (VRUs) trajectory prediction aims to analyze the future movements of pedestrians and cyclists for intelligent driving. Most previous methods just focus on VRUs trajectory prediction using idealized complete observations, and rare consider occlusions and tracking losses. Focus on the incomplete observation problem, we propose a novel Observation Store and Query Fusion Network (OSQF-Net), for VRUs trajectory prediction with incomplete observation. Firstly, based on the external memory bank mechanism and complete-incomplete observation joint training strategy, a Memory Bank-based Feature Store and Query Module (MSQ-Module) is proposed to extract complete motion features, from disrupted motion patterns caused by incomplete observation. Subsequently, based on temporal extraction and attention mechanism, a Spatio-Temporal Fusion Module (STF-Module) is proposed to effectively fuse the pseudo-complete motion features and incomplete motion features in both spatial and temporal dimensions. Finally, with these two modules and a CVAE network, the OSQF-Net can generate a latent space with complete motion patterns, which guides future trajectory prediction. Experimental results demonstrate that OSQF-Net achieves superior prediction performance and real-time inference capability for egocentric VRUs trajectory prediction, under both complete and incomplete observation scenarios.Keywords
Funding Information
- National Natural Science Foundation of China (U22A2058, 62176138, 62176136)
- Shandong Outstanding Youth Funding (ZR2023YQ054)
- shandong provincial key research and development program (2019JZZY010130, 2020CXGC010207)
This publication has 44 references indexed in Scilit:
- Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centers2021
- Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning2021
- A Two-Block RNN-Based Trajectory Prediction From Incomplete TrajectoryIEEE Access, 2021
- LSTM based trajectory prediction model for cyclist utilizing multiple interactions with environmentPattern Recognition, 2021
- MissFormer: (In-)Attention-Based Handling of Missing Observations for Trajectory Filtering and Prediction2021
- TPNet: Trajectory Proposal Network for Motion Prediction2020
- SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints2019
- Cyclist Trajectory Prediction Using Bidirectional Recurrent Neural Networks2018
- Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks2018
- Learning an Image-Based Motion Context for Multiple People Tracking2014