Anticipating Many Futures: Online Human Motion Prediction and Generation for Human-Robot Interaction
Authors:
- 1 May 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4563-4570
Abstract
Fluent and safe interactions of humans and robots require both partners to anticipate the others' actions. The bottleneck of most methods is the lack of an accurate model of natural human motion. In this work, we present a conditional variational autoencoder that is trained to predict a window of future human motion given a window of past frames. Using skeletal data obtained from RGB depth images, we show how this unsupervised approach can be used for online motion prediction for up to 1660 ms. Additionally, we demonstrate online target prediction within the first 300-500 ms after motion onset without the use of target specific training data. The advantage of our probabilistic approach is the possibility to draw samples of possible future motion patterns. Finally, we investigate how movements and kinematic cues are represented on the learned low dimensional manifold.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- On Human Motion Prediction Using Recurrent Neural Networks2017
- Anticipatory Planning for Human-Robot Teams2015
- A framework for unsupervised online human reaching motion recognition and early prediction2015
- Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification2015
- I give you a cup, I get a cup: A kinematic study on social intentionNeuropsychologia, 2014
- Kinematics fingerprints of leader and follower role-taking during cooperative joint actionsExperimental Brain Research, 2013
- Microsoft Kinect Sensor and Its EffectIEEE MultiMedia, 2012
- What should I do next? Using shared representations to solve interaction problemsExperimental Brain Research, 2011
- Does the intention to communicate affect action kinematics?Consciousness and Cognition, 2009
- MOSAIC Model for Sensorimotor Learning and ControlNeural Computation, 2001