A DDPG-Based USV Path-Planning Algorithm
Open Access
- 22 September 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (19) , 10567
Abstract
Path planning is crucial in the automatic navigation of USVs (unmanned underwater vehicles), which directly affects the operational efficiency and safety of USVs. In this paper, we propose a path-planning algorithm based on DDPG (Deep Deterministic Policy Gradient) and make a detailed comparison with the traditional A-Star algorithm and the recent Actor–Critical algorithm. Through a series of simulation experiments, it can be observed that the optimal path for USVs found by the DDPG-based path planning algorithm is faster and more accurate than that found by the other two methods. The experimental results show that the DDPG algorithm has a significant advantage in processing time and better performance in terms of path quality and safety. These results provide a strong reference for future research on automatic navigation for USVs and demonstrate the potential of DDPG-based path planning for USVs.Keywords
Funding Information
- National Science Foundation of China (51679024, 2020RT08, 3132021139)
- Dalian Innovation Team Support Plan in the Key Research Field (51679024, 2020RT08, 3132021139)
- Fundamental Research Funds for the Central Universities (51679024, 2020RT08, 3132021139)
This publication has 21 references indexed in Scilit:
- Smoothed A* algorithm for practical unmanned surface vehicle path planningApplied Ocean Research, 2019
- A Two Layered Optimal Approach towards Cooperative Motion Planning of Unmanned Surface Vehicles in a Constrained Maritime EnvironmentIFAC-PapersOnLine, 2018
- Feasibility study of a constrained Dijkstra approach for optimal path planning of an unmanned surface vehicle in a dynamic maritime environment2018
- A new approach to smooth global path planning of mobile robots with kinematic constraintsInternational Journal of Machine Learning and Cybernetics, 2017
- Gaussian mixture model and receding horizon control for multiple UAV search in complex environmentNonlinear Dynamics, 2017
- Neural networks based reinforcement learning for mobile robots obstacle avoidanceExpert Systems with Applications, 2016
- A new mobile robot navigation using a turning point searching algorithm with the consideration of obstacle avoidanceThe International Journal of Advanced Manufacturing Technology, 2010
- Reinforcement Learning: A SurveyJournal of Artificial Intelligence Research, 1996
- Shortest Connection Networks And Some GeneralizationsBell System Technical Journal, 1957
- On the shortest spanning subtree of a graph and the traveling salesman problemProceedings of the American Mathematical Society, 1956