A Bilateral Teleoperation Strategy Augmented by EMGP-VH for Live-Line Maintenance Robot
- 26 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 54 (4) , 362-374
Abstract
In robot-assisted live-line maintenance, bilateral teleoperation is still a popular and effective approach in assisting operators to accomplish hazards tasks. Particularly, teleoperation under overhead power lines attach greater expectation on safe operation and telepresence. In this article, we propose a visual-haptic bilateral teleoperation strategy, i.e., EMGP-VH , based on visual guidance, haptic constraint and mixed reality (MR) augmentation. To the best of our knowledge, electromagnetic field is first applied to serve the path planning of teleoperation in live-line maintenance. In visual guidance, EMG-potential fields are integrated into RRT* to calculate a low-energy path. At the same time, real-time haptic constraint is calculated based on a tube virtual fixture. MR augmentation also works as an indispensable part in both the platform construction and visual guidance. Our proposal has been extensively compared using seven objective performances and three subjective questionnaires both in simulation and real-world experiment with five different scenes and two approaches state-of-the-art, respectively. Functionality of EMGP-RRT* and effectiveness of haptic constraint are further analyzed. Results show that EMGP-RRT* has significant improvements both in searching efficiency and safety performances; and the proposed system ( EMGP-VH ) significantly contributes to improving telepresence and ensuring safe operations during live-line maintenance, resulting in a 30% reduction in operation time and a 60% decrease in trajectory offset.Keywords
Funding Information
- Natural Science Foundation of Guangxi (2023GXNSFBA026069)
- Innovation Project of Guangxi Graduate Education (YCSW2022077)
- young and middle-aged teachers in Guangxi's colleges and universities (2022KY0008)
This publication has 48 references indexed in Scilit:
- A survey of intelligent transmission line inspection based on unmanned aerial vehicleArtificial Intelligence Review, 2022
- Mixed reality-integrated 3D/2D vision mapping for intuitive teleoperation of mobile manipulatorRobotics and Computer-Integrated Manufacturing, 2022
- What is XR? Towards a Framework for Augmented and Virtual RealityComputers in Human Behavior, 2022
- Empowering smart grid: A comprehensive review of energy storage technology and application with renewable energy integrationJournal of Energy Storage, 2021
- Development of assistive robotic arm for power line maintenancePrecision Engineering, 2021
- Power transmission line inspection robots: A review, trends and challenges for future researchInternational Journal of Electrical Power & Energy Systems, 2020
- Learning analytics for student modeling in virtual reality training systems: Lineworkers caseComputers & Education, 2020
- DCBot: An autonomous hot-line working robot for 110 kV substationRobotics and Autonomous Systems, 2019
- The use of a virtual reality training system to improve technical skill in the maintenance of live-line power distribution networksInteractive Learning Environments, 2019
- An augmented virtual fixture to improve task performance in robot-assisted live-line maintenanceComputers and Electrical Engineering, 2015