Robust Human Upper Limbs Trajectory Predictor for Human-Robot Collaboration
- 17 November 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2388-2393
Abstract
Accurately sensing the human posture information of collaborators is the critical technology to achieve human-robot collaboration, which can effectively improve the security of collaborative tasks. However, the pose of the collaborator, especially the motion trajectory of the human upper limb has the characteristics of randomness and sudden change. To solve the instability of prediction probability caused by the sudden change of trajectory and improve the prediction accuracy, this paper proposes a novel motion trajectory predictor for the human upper limb (GMM-LSTM). The algorithm can be described as follows: (1) according to the statistical feature of Human Upper Limbs motion, a joint probability distribution is inferred as its cluster model. A human upper limbs trajectory dataset can be clustered using this distribution as a sub-dataset. (2) an improved long and short-term memory network is proposed to predicate the future motion in three directions under the spatial coordinate system conditioned on the observed motion. (3) in the end, one fuse the predicted values of the three directions to generate the future trajectories. The experimental results show that the algorithm's overall prediction error consistently falls within a range of 1cm, indicating a high degree of robustness.Keywords
Funding Information
- Department of Science and Technology of Shandong Province
- Jinan Science and Technology Bureau (2019KJN010,2021GXRC071)
This publication has 19 references indexed in Scilit:
- An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generationRobotics and Computer-Integrated Manufacturing, 2022
- A Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial SettingsRobotics and Computer-Integrated Manufacturing, 2022
- Data Driven Models for Human Motion Prediction in Human-Robot CollaborationIEEE Access, 2020
- Safety bounds in human robot interaction: A surveySafety Science, 2020
- Anticipation in Human-Robot Cooperation: A Recurrent Neural Network Approach for Multiple Action Sequences Prediction2018
- Predicting Human Actions Taking into Account Object AffordancesJournal of Intelligent & Robotic Systems, 2018
- NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis2016
- Safety issues in human-robot interactions2013
- View invariant human action recognition using histograms of 3D joints2012
- Human arm motion modeling and long-term prediction for safe and efficient Human-Robot-Interaction2011