GET-DIPP: Graph-Embedded Transformer for Differentiable Integrated Prediction and Planning
Preprint
Abstract
Accurately predicting interactive road agents' future trajectories and planning a socially compliant and human-like trajectory accordingly are important for autonomous vehicles. In this paper, we propose a planning-centric prediction neural network, which takes surrounding agents' historical states and map context information as input, and outputs the joint multi-modal prediction trajectories for surrounding agents, as well as a sequence of control commands for the ego vehicle by imitation learning. An agent-agent interaction module along the time axis is proposed in our network architecture to better comprehend the relationship among all the other intelligent agents on the road. To incorporate the map's topological information, a Dynamic Graph Convolutional Neural Network (DGCNN) is employed to process the road network topology. Besides, the whole architecture can serve as a backbone for the Differentiable Integrated motion Prediction with Planning (DIPP) method by providing accurate prediction results and initial planning commands. Experiments are conducted on real-world datasets to demonstrate the improvements made by our proposed method in both planning and prediction accuracy compared to the previous state-of-the-art methods.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Differentiable Integrated Motion Prediction and Planning With Learnable Cost Function for Autonomous DrivingIEEE Transactions on Neural Networks and Learning Systems, 2023
- This is the Way: Differential Bayesian Filtering for Agile Trajectory SynthesisIEEE Robotics and Automation Letters, 2022
- FISS: A Trajectory Planning Framework Using Fast Iterative Search and Sampling Strategy for Autonomous DrivingIEEE Robotics and Automation Letters, 2022
- Multi-Agent Trajectory Prediction With Heterogeneous Edge-Enhanced Graph Attention NetworkIEEE Transactions on Intelligent Transportation Systems, 2022
- Dynamic Graph CNN for Learning on Point CloudsACM Transactions on Graphics, 2019
- ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst2019
- Little Ben: The Ben Franklin Racing Team's entry in the 2007 DARPA Urban ChallengeJournal of Field Robotics, 2008