Deep Reinforcement Learning for Autonomous Driving with an Auxiliary Actor Discriminator
Open Access
Abstract
In the research of robot systems, path planning and obstacle avoidance are important research directions, especially in unknown dynamic environments where flexibility and rapid decision makings are required. In this paper, a state attention network (SAN) was developed to extract features to represent the interaction between an intelligent robot and its obstacles. An auxiliary actor discriminator (AAD) was developed to calculate the probability of a collision. Goal-directed and gap-based navigation strategies were proposed to guide robotic exploration. The proposed policy was trained through simulated scenarios and updated by the Soft Actor-Critic (SAC) algorithm. The robot executed the action depending on the AAD output. Heuristic knowledge (HK) was developed to prevent blind exploration of the robot. Compared to other methods, adopting our approach in robot systems can help robots converge towards an optimal action strategy. Furthermore, it enables them to explore paths in unknown environments with fewer moving steps (showing a decrease of 33.9%) and achieve higher average rewards (showning an increase of 29.15%).Keywords
Funding Information
- Ningbo K&D Project (2023Z116)
- Open Foundation of the State Key Laboratory of Fluid Power and Mechatronic Systems (2023Z116)
This publication has 26 references indexed in Scilit:
- Optimal and Autonomous Control Using Reinforcement Learning: A SurveyIEEE Transactions on Neural Networks and Learning Systems, 2017
- Modified artificial potential field method for online path planning applications2017
- Decentralized cooperative mean approach to collision avoidance for nonholonomic mobile robots2015
- Human-level control through deep reinforcement learningNature, 2015
- An adaptive obstacle avoidance algorithm for unmanned surface vehicle in complicated marine environmentsIEEE/CAA Journal of Automatica Sinica, 2014
- Distributed Neural Network Control for Adaptive Synchronization of Uncertain Dynamical Multiagent SystemsIEEE Transactions on Neural Networks and Learning Systems, 2013
- A note on the complexity of Dijkstra's algorithm for graphs with weighted verticesIEEE Transactions on Computers, 1998
- Probabilistic roadmaps for path planning in high-dimensional configuration spacesIEEE Transactions on Robotics and Automation, 1996
- Robot Motion Planning: A Distributed Representation ApproachThe International Journal of Robotics Research, 1991
- A result on the computational complexity of heuristic estimates for the A∗ algorithmInformation Sciences, 1984