Learning to predict trajectories of cooperatively navigating agents
Authors:
- 1 May 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 4015-4020
Abstract
The problem of modeling the navigation behavior of multiple interacting agents arises in different areas including robotics, computer graphics, and behavioral science. In this paper, we present an approach to learn the composite navigation behavior of interacting agents from demonstrations. The decision process that ultimately leads to the observed continuous trajectories of the agents often also comprises discrete decisions, which partition the space of composite trajectories into homotopy classes. Therefore, our method uses a mixture probability distribution that consists of a discrete distribution over the homotopy classes and continuous distributions over the composite trajectories for each homotopy class. Our approach learns the model parameters of this distribution that match, in expectation, the observed behavior in terms of user-defined features. To compute the feature expectations over the high-dimensional continuous distributions, we use Hamiltonian Markov chain Monte Carlo sampling. We exploit that the distributions are highly structured due to physical constraints and guide the sampling process to regions of high probability. We apply our approach to learning the behavior of pedestrians and demonstrate that it outperforms state-of-the-art methods.Keywords
This publication has 15 references indexed in Scilit:
- A statistical similarity measure for aggregate crowd dynamicsACM Transactions on Graphics, 2012
- An Optimality Principle Governing Human WalkingIEEE Transactions on Robotics, 2008
- Crowds by ExampleComputer Graphics Forum, 2007
- Maximum margin planning2006
- Apprenticeship learning via inverse reinforcement learning2004
- Simulation of pedestrian flows by optimal control and differential gamesOptimal Control Applications and Methods, 2003
- A direct adaptive method for faster backpropagation learning: the RPROP algorithm2002
- Social force model for pedestrian dynamicsPhysical Review E, 1995
- Hybrid Monte CarloPhysics Letters B, 1987
- Monte Carlo sampling methods using Markov chains and their applicationsBiometrika, 1970