Abstract
This paper presents a virtual reality (VR) human-robot interaction welding system which allows human welders to manipulate a welding robot and undertake welding tasks naturally and intuitively via consumer-grade VR hardware (HTC Vive). In this system, human welders' operations are captured by motion-tracked handle controllers and used as commands to teleoperate a 6-DoF industrial robot (UR-5) and to request welding current from a controllable welding power supply (Liburdi Pulsweld P200). The 3D working scene is rendered in real time based on feedback information and shown to the human welder by head-mounted display (HMD) via a motion-tracked headset. To compensate for the time delay between command motion and real motion of the robot, a hidden Markov model (HMM) is proposed to model and predict human welders' operations. The K-means clustering algorithm is applied to cluster human welders' operation data (traveling speed) into latent states. Based on the developed prediction algorithm, the motion of human welders is predicted with an RMSE accuracy of between 2.1 and 4.6mm/s. The position data used as final commands to teleoperate a robot is predicted with an RMSE accuracy of between 1.1 and 2.3mm. This paper presents a general cyber-physical model for human-robot interactive welding based on VR, building a foundation for welding robot teleoperation.

This publication has 37 references indexed in Scilit: