Vision-Based Multi-Future Trajectory Prediction: A Survey
- 24 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (8) , 13691-13708
Abstract
Vision-based trajectory prediction is an important task that supports safe and intelligent behaviors in autonomous systems. Many advanced approaches have been proposed over the years with improved spatial and temporal feature extraction. However, human behavior is naturally diverse and uncertain. Given the past trajectory and surrounding environment information, an agent can have multiple plausible trajectories in the future. To tackle this problem, an essential task named multi-future trajectory prediction (MTP) has recently been studied. This task aims to generate a diverse, acceptable, and explainable distribution of future predictions for each agent. In this article, we present the first survey for MTP with our unique taxonomies and a comprehensive analysis of frameworks, datasets, and evaluation metrics. We also compare models on existing MTP datasets and conduct experiments on the ForkingPath dataset. Finally, we discuss multiple future directions that can help researchers develop novel MTP systems and other diverse learning tasks similar to MTP.Keywords
All Related Versions
This publication has 125 references indexed in Scilit:
- Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimation2021
- Trajectron++: Dynamically-Feasible Trajectory Forecasting with Heterogeneous Data2020
- SimAug: Learning Robust Representations from Simulation for Trajectory Prediction2020
- Take a NAP: Non-Autoregressive Prediction for Pedestrian Trajectories2020
- End-to-End Object Detection with Transformers2020
- It Is Not the Journey But the Destination: Endpoint Conditioned Trajectory Prediction2020
- Learning Lane Graph Representations for Motion Forecasting2020
- Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction2020
- Trajectory Prediction by Coupling Scene-LSTM with Human Movement LSTM2019
- CAR-Net: Clairvoyant Attentive Recurrent Network2018