A Scalable Approach to Predict Multi-Agent Motion for Human-Robot Collaboration
- 11 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 1686-1693
Abstract
Human motion prediction is considered a key component for enabling fluent human-robot collaboration. The ability to anticipate the motion and subsequent intent of the partner(s) remains a challenging task due to the complex and interpersonal nature of human behavior. In this work, we propose a novel sequence learning approach that learns a robust representation over the observed human motion and can condition future predictions over a subset of past sequences. Our approach works for both single and multi-agent settings and relies on an interpretable latent space that has the implicit benefit of improving human motion understanding. We evaluated the proposed approach by comparing its performance against state-of-the-art motion prediction methods on single, multi-agent, and human-robot collaboration datasets. The results suggest that our approach outperforms other methods over all the evaluated temporal horizons, for single-agent and multi-agent motion prediction. The improved performance of our approach for both single and multi-agent settings, coupled with an interpretable latent space, can enable close-proximity human-robot collaboration.Keywords
Funding Information
- CCAM Innovation
This publication has 35 references indexed in Scilit:
- Movement Coordination in Human–Robot Teams: A Dynamical Systems ApproachIEEE Transactions on Robotics, 2016
- Probabilistic movement primitives for coordination of multiple human–robot collaborative tasksAutonomous Robots, 2016
- Recurrent Network Models for Human Dynamics2015
- Panoptic Studio: A Massively Multiview System for Social Motion Capture2015
- UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor2015
- A Method for Automatic Detection of Psychomotor EntrainmentIEEE Transactions on Affective Computing, 2015
- Mixed Pooling for Convolutional Neural Networks2014
- Sensorimotor synchronization: A review of recent research (2006–2012)Psychonomic Bulletin & Review, 2013
- Joint action: bodies and minds moving togetherTrends in Cognitive Sciences, 2006
- A Learning Algorithm for Continually Running Fully Recurrent Neural NetworksNeural Computation, 1989