Modeling of Human Welders’ Operations in Virtual Reality Human–Robot Interaction
- 10 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 4 (3) , 2958-2964
Abstract
This paper presents a virtual reality (VR) human-robot interaction welding system which allows human welders to manipulate a welding robot and undertake welding tasks naturally and intuitively via consumer-grade VR hardware (HTC Vive). In this system, human welders' operations are captured by motion-tracked handle controllers and used as commands to teleoperate a 6-DoF industrial robot (UR-5) and to request welding current from a controllable welding power supply (Liburdi Pulsweld P200). The 3D working scene is rendered in real time based on feedback information and shown to the human welder by head-mounted display (HMD) via a motion-tracked headset. To compensate for the time delay between command motion and real motion of the robot, a hidden Markov model (HMM) is proposed to model and predict human welders' operations. The K-means clustering algorithm is applied to cluster human welders' operation data (traveling speed) into latent states. Based on the developed prediction algorithm, the motion of human welders is predicted with an RMSE accuracy of between 2.1 and 4.6mm/s. The position data used as final commands to teleoperate a robot is predicted with an RMSE accuracy of between 1.1 and 2.3mm. This paper presents a general cyber-physical model for human-robot interactive welding based on VR, building a foundation for welding robot teleoperation.Keywords
This publication has 37 references indexed in Scilit:
- Intelligent modeling for estimating weld bead width and depth of penetration from infra-red thermal images of the weld poolJournal of Intelligent Manufacturing, 2013
- A system for rapid creation and assessment of conceptual large vehicle designs using immersive virtual realityComputers in Industry, 2012
- Recent progress on programming methods for industrial robotsRobotics and Computer-Integrated Manufacturing, 2012
- Virtual Reality Content-Based Training for Spray Painting Tasks in the Shipbuilding IndustryETRI Journal, 2010
- Virtual reality for assembly methods prototyping: a reviewVirtual Reality, 2010
- Teleteaching approach for sensor‐based arc welding telerobotic systemIndustrial Robot: the international journal of robotics research and application, 2007
- Present and future robot control development—An industrial perspectiveAnnual Reviews in Control, 2007
- From CAD to virtual reality: modelling approaches, data exchange and interactive 3D building design toolsAutomation in Construction, 2000
- Synchronous weld pool oscillation for monitoring and controlIEEE Transactions on Industry Applications, 1997
- Hidden Markov model approach to skill learning and its application to teleroboticsIEEE Transactions on Robotics and Automation, 1994