Path planning algorithm for mobile robots using value distribution and LSTM-based Soft Actor-Critic
- 27 February 2026
- journal article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 37 (8) , 086203
Abstract
To address unstable value estimation and insufficient use of temporal information by the soft Actor–Critic (SAC) algorithm in dynamic environments, we propose an improved SAC-based path-planning method that integrates distributional value learning and long short-term memory (LSTM). First, the critic models the return distribution via quantile regression to reduce the variance of value estimates and improve the stability of policy evaluation. Second, an LSTM encodes historical obstacle observations to enhance prediction of environmental dynamics and decision-making. Through comparative experiments in dynamic scenarios on the Gazebo simulation platform, the proposed method outperforms LSTM-enhanced DDPG, vanilla SAC, distributional SAC, and LSTM-SAC in average path length, average steps, and average planning time. Moreover, real-world experiments further verify the feasibility and robustness of the approach.Keywords
Funding Information
- Guangxi Key Research and Development Program (AB25069274)
- Key Laboratory of AI and Information Processing (Hechi University), Education Department of Guangxi Zhuang Autonomous Region (2022GXZDSY003)
- Guangxi Science and Technology Major Program (AA23023015)
This publication has 36 references indexed in Scilit:
- Advanced discrete SAC-based speed and lane change decision-making method for autonomous vehicle in highway scenarioKnowledge-Based Systems, 2025
- A dynamic control decision approach for fixed-wing aircraft games via hybrid action reinforcement learningScience China Information Sciences, 2025
- Estimation of the legs’ state of a mobile robot based on Long Short-Term Memory networkEngineering Applications of Artificial Intelligence, 2024
- Mobile robot path planning using deep deterministic policy gradient with differential gaming (DDPG-DG) explorationCognitive Robotics, 2024
- UAV 3D online track planning based on improved SAC algorithmJournal of the Brazilian Society of Mechanical Sciences and Engineering, 2023
- Dynamic path planning of mobile robots using adaptive dynamic programmingExpert Systems with Applications, 2023
- Dynamic path planning of mobile robot based on improved simulated annealing algorithmJournal of the Franklin Institute, 2023
- Soft Actor-Critic for Navigation of Mobile RobotsJournal of Intelligent & Robotic Systems, 2021
- Path planning for indoor Mobile robot based on deep learningOptik, 2020
- An optimizing BP neural network algorithm based on genetic algorithmArtificial Intelligence Review, 2011