Deep Visual-guided and Deep Reinforcement Learning Algorithm Based for Multip-Peg-in-Hole Assembly Task of Power Distribution Live-line Operation Robot
Open Access
- 18 May 2024
- journal article
- research article
- Published by Springer Nature in Journal of Intelligent & Robotic Systems
- Vol. 110 (2) , 1-19
Abstract
The inspection and maintenance of power distribution network are crucial for efficiently delivering electricity to consumers. Due to the high voltage of power distribution network lines, manual live-line operations are difficult, risky, and inefficient. This paper researches a Power Distribution Network Live-line Operation Robot (PDLOR) with autonomous tool assembly capabilities to replace humans in various high-risk electrical maintenance tasks. To address the challenges of tool assembly in dynamic and unstructured work environments for PDLOR, we propose a framework consisting of deep visual-guided coarse localization and prior knowledge and fuzzy logic driven deep deterministic policy gradient (PKFD-DPG) high-precision assembly algorithm. First, we propose a multiscale identification and localization network based on YOLOv5, which enables the peg-hole close quickly and reduces ineffective exploration. Second, we design a main-auxiliary combined reward system, where the main-line reward uses the hindsight experience replay mechanism, and the auxiliary reward is based on fuzzy logic inference mechanism, addressing ineffective exploration and sparse reward in the learning process. In addition, we validate the effectiveness and advantages of the proposed algorithm through simulations and physical experiments, and also compare its performance with other assembly algorithms. The experimental results show that, for single-tool assembly tasks, the success rate of PKFD-DPG is 15.2% higher than the DDPG with functionized reward functions and 51.7% higher than the PD force control method; for multip-tools assembly tasks, the success rate of PKFD-DPG method is 17% and 53.4% higher than the other methods.Keywords
This publication has 39 references indexed in Scilit:
- An Efficiently Convergent Deep Reinforcement Learning-Based Trajectory Planning Method for Manipulators in Dynamic EnvironmentsJournal of Intelligent & Robotic Systems, 2023
- A review of robotic assembly strategies for the full operation procedure: planning, execution and evaluationRobotics and Computer-Integrated Manufacturing, 2022
- A Review of Yolo Algorithm DevelopmentsProcedia Computer Science, 2022
- Machine Learning and Deep Learning in smart manufacturing: The Smart Grid paradigmComputer Science Review, 2021
- Reward Function Design in Reinforcement Learning2021
- Power transmission line inspection robots: A review, trends and challenges for future researchInternational Journal of Electrical Power & Energy Systems, 2020
- Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learningInternational Journal of Electrical Power & Energy Systems, 2018
- A Study on Error Recovery Search Strategies of Electronic Connector Mating for Robotic Fault-Tolerant AssemblyJournal of Intelligent & Robotic Systems, 2015
- Fuzzy Rule-Based Systems2015
- Position Identification in Force-Guided Robotic Peg-in-Hole Assembly TasksProcedia CIRP, 2014