Human Motion Prediction Using Adaptable Recurrent Neural Networks and Inverse Kinematics
- 25 May 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3725-3730
Abstract
Human motion prediction, especially arm prediction, is critical to facilitate safe and efficient human-robot collaboration (HRC). This paper proposes a novel human motion prediction framework that combines a recurrent neural network (RNN) and inverse kinematics (IK) to predict human arm motion. A modified Kalman filter (MKF) is applied to adapt the model online. The proposed framework is tested on collected human motion data with up to 2 s prediction horizon. The experiments demonstrate that the proposed method improves the prediction accuracy by approximately 14% comparing to the state-of-art on seen situations. It stably adapts to unseen situations by keeping the maximum prediction error under 4 cm, which is 70% lower than other methods. Moreover, it is robust when the arm is partially occluded. The wrist prediction remains the same, while the elbow prediction has 20% less variation.Keywords
Funding Information
- Ford Motor Company
This publication has 17 references indexed in Scilit:
- OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity FieldsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- On Human Motion Prediction Using Recurrent Neural Networks2017
- Structural-RNN: Deep Learning on Spatio-Temporal Graphs2016
- Recurrent Network Models for Human Dynamics2015
- Predicting human reaching motion in collaborative tasks using Inverse Optimal Control and iterative re-planning2015
- Prediction of distal arm joint angles from EMG and shoulder orientation for prosthesis control2012
- Planning-based prediction for pedestrians2009
- Long Short-Term MemoryNeural Computation, 1997
- Robust Estimation of a Location ParameterThe Annals of Mathematical Statistics, 1964
- Stochastic Estimation of the Maximum of a Regression FunctionThe Annals of Mathematical Statistics, 1952