MATRIX: Multi-Agent Trajectory Generation with Diverse Contexts
Authors:
- Zhuo XuZXZhuo Xu
- Rui ZhouRZRui Zhou
- Yida YinYYYida Yin
- Huidong GaoHGHuidong Gao
- Masayoshi TomizukaMTMasayoshi Tomizuka
- Jiachen LiJLJiachen Li
Preprint
Abstract
Data-driven methods have great advantages in modeling complicated human behavioral dynamics and dealing with many human-robot interaction applications. However, collecting massive and annotated real-world human datasets has been a laborious task, especially for highly interactive scenarios. On the other hand, algorithmic data generation methods are usually limited by their model capacities, making them unable to offer realistic and diverse data needed by various application users. In this work, we study trajectory-level data generation for multi-human or human-robot interaction scenarios and propose a learning-based automatic trajectory generation model, which we call Multi-Agent TRajectory generation with dIverse conteXts (MATRIX). MATRIX is capable of generating interactive human behaviors in realistic diverse contexts. We achieve this goal by modeling the explicit and interpretable objectives so that MATRIX can generate human motions based on diverse destinations and heterogeneous behaviors. We carried out extensive comparison and ablation studies to illustrate the effectiveness of our approach across various metrics. We also presented experiments that demonstrate the capability of MATRIX to serve as data augmentation for imitation-based motion planning.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Distributed Multi-Agent Interaction Generation with Imagined Potential Games2024
- Generative Expressive Robot Behaviors using Large Language Models2024
- Disentangled Neural Relational Inference for Interpretable Motion PredictionIEEE Robotics and Automation Letters, 2023
- Holistic transformer: A joint neural network for trajectory prediction and decision-making of autonomous vehiclesPattern Recognition, 2023
- Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and TrackingIEEE Transactions on Intelligent Transportation Systems, 2021
- Cascade Attribute Network: Decomposing Reinforcement Learning Control Policies using Hierarchical Neural NetworksIFAC-PapersOnLine, 2020
- Analysis of Recurrent Neural Networks for Probabilistic Modeling of Driver BehaviorIEEE Transactions on Intelligent Transportation Systems, 2016
- Continuum crowdsACM Transactions on Graphics, 2006
- Social force model for pedestrian dynamicsPhysical Review E, 1995