Continual Multi-Agent Interaction Behavior Prediction With Conditional Generative Memory
- 12 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (4) , 8410-8417
Abstract
Multi-agent trajectory prediction plays a crucial role in robotics and autonomous driving. The current mainstream research focuses on how to achieve accurate prediction on one large dataset. However, whether the multi-agent trajectory prediction model can be trained with sequential datasets, i.e. continual learning settings, remains a question. Can the current prediction methods avoid catastrophic forgetting Can we utilize the continual learning strategy in multi-agent trajectory prediction application Motivated by the rehearsal methods in continual learning literature, we propose a multi-agent interaction behavior prediction framework with graph-neural-network-based conditional generative memory system to mitigate catastrophic forgetting. To the best of our knowledge, this work is the first attempt to study the continual learning problem in multi-agent interaction behavior prediction problems. We empirically show that several approaches in literature indeed suffer from catastrophic forgetting, and our approach succeeds in maintaining a low prediction error when data comes in a sequential way. We also conduct an ablation analysis to show the effectiveness and necessity of our proposed conditional generative memory system.Keywords
This publication has 18 references indexed in Scilit:
- GRIP: Graph-based Interaction-aware Trajectory Prediction2019
- Complementary Learning for Overcoming Catastrophic Forgetting Using Experience Replay2019
- TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-AgentsProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Wasserstein Generative Learning with Kinematic Constraints for Probabilistic Interactive Driving Behavior Prediction2019
- AGen: Adaptable Generative Prediction Networks for Autonomous Driving2019
- Interaction-aware Multi-agent Tracking and Probabilistic Behavior Prediction via Adversarial Learning2019
- Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks2018
- DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents2017
- Intention estimation for ramp merging control in autonomous driving2017
- Social LSTM: Human Trajectory Prediction in Crowded Spaces2016