A Path-Planning Method Based on Improved Soft Actor-Critic Algorithm for Mobile Robots
Open Access
- 10 October 2023
- journal article
- research article
- Published by MDPI AG in Biomimetics
- Vol. 8 (6) , 481
Abstract
The path planning problem has gained more attention due to the gradual popularization of mobile robots. The utilization of reinforcement learning techniques facilitates the ability of mobile robots to successfully navigate through an environment containing obstacles and effectively plan their path. This is achieved by the robots’ interaction with the environment, even in situations when the environment is unfamiliar. Consequently, we provide a refined deep reinforcement learning algorithm that builds upon the soft actor-critic (SAC) algorithm, incorporating the concept of maximum entropy for the purpose of path planning. The objective of this strategy is to mitigate the constraints inherent in conventional reinforcement learning, enhance the efficacy of the learning process, and accommodate intricate situations. In the context of reinforcement learning, two significant issues arise: inadequate incentives and inefficient sample use during the training phase. To address these challenges, the hindsight experience replay (HER) mechanism has been presented as a potential solution. The HER mechanism aims to enhance algorithm performance by effectively reusing past experiences. Through the utilization of simulation studies, it can be demonstrated that the enhanced algorithm exhibits superior performance in comparison with the pre-existing method.Keywords
Funding Information
- National Natural Science Foundation of China (62073196, U1806204)
This publication has 28 references indexed in Scilit:
- A review: On path planning strategies for navigation of mobile robotDefence Technology, 2019
- A biobjective Dijkstra algorithmEuropean Journal of Operational Research, 2019
- Local Path Planning Algorithm for Blind-guiding Robot Based on Improved DWA Algorithm2019
- Genetic Algorithm Based Approach for Autonomous Mobile Robot Path PlanningProcedia Computer Science, 2018
- Dynamic path planning based on adaptable Ant colony optimization algorithm2017
- A novel RRT*-based algorithm for motion planning in Dynamic environments2017
- Survey of Model-Based Reinforcement Learning: Applications on RoboticsJournal of Intelligent & Robotic Systems, 2017
- Neural networks based reinforcement learning for mobile robots obstacle avoidanceExpert Systems with Applications, 2016
- Advance Particle Swarm Optimization-Based Navigational Controller For Mobile RobotArabian Journal for Science and Engineering, 2014
- A new APF strategy for path planning in environments with obstaclesMechanism and Machine Theory, 2005