ImprovedQ‐Learning Method for Multirobot Formation and Path Planning with Concave Obstacles
Open Access
- 1 January 2021
- journal article
- research article
- Published by Wiley in Journal of Sensors
- Vol. 2021 (1)
Abstract
Aiming at the formation and path planning of multirobot systems in an unknown environment, a path planning method for multirobot formation based on improvedQ‐learning is proposed. Based on the leader‐following approach, the leader robot uses an improvedQ‐learning algorithm to plan the path and the follower robot achieves a tracking strategy of gravitational potential field (GPF) by designing a cost function to select actions. Specifically, to improve the Q‐learning,Q‐value is initialized by environmental guidance of the target’s GPF. Then, the virtual obstacle‐filling avoidance strategy is presented to fill non‐obstacles which is judged to tend to concave obstacles with virtual obstacles. Besides, the simulated annealing (SA) algorithm whose controlling temperature is adjusted in real time according to the learning situation of theQ‐learning is applied to improve the action selection strategy. The experimental results show that the improvedQ‐learning algorithm reduces the convergence time by 89.9% and the number of convergence rounds by 63.4% compared with the traditional algorithm. With the help of the method, multiple robots have a clear division of labor and quickly plan a globally optimized formation path in a completely unknown environment.Keywords
Funding Information
- Natural Science Foundation of Shandong Province (ZR2018ZC0438)
- National Natural Science Foundation of China (61673200)
This publication has 18 references indexed in Scilit:
- A knowledge-free path planning approach for smart ships based on reinforcement learningOcean Engineering, 2019
- Solving the optimal path planning of a mobile robot using improved Q-learningRobotics and Autonomous Systems, 2019
- Obstacle Avoidance and Navigation Planning of a Wheeled Mobile Robot using Amended Artificial Potential Field MethodProcedia Computer Science, 2018
- Vector Field Based Formation Control of Multi-Robot SystemIFAC-PapersOnLine, 2016
- A survey of multi-agent formation controlAutomatica, 2015
- A Totally Astar-based Multi-path Algorithm for the Recognition of Reasonable Route Sets in Vehicle Navigation SystemsProcedia - Social and Behavioral Sciences, 2013
- An improved genetic algorithm with co-evolutionary strategy for global path planning of multiple mobile robotsNeurocomputing, 2013
- Leader-Follower Formation Control of Multiple Non-holonomic Mobile Robots Incorporating a Receding-horizon SchemeThe International Journal of Robotics Research, 2009
- High Precision Formation Control of Mobile Robots Using Virtual StructuresAutonomous Robots, 1997
- Q-learningMachine Learning, 1992