Deep reinforcement learning for map-less goal-driven robot navigation
Authors:
Open Access
- 1 January 2021
- journal article
- research article
- Published by SAGE Publications in International Journal of Advanced Robotic Systems
- Vol. 18 (1)
Abstract
Mobile robots that operate in real-world environments need to be able to safely navigate their surroundings. Obstacle avoidance and path planning are crucial capabilities for achieving autonomy of such systems. However, for new or dynamic environments, navigation methods that rely on an explicit map of the environment can be impractical or even impossible to use. We present a new local navigation method for steering the robot to global goals without relying on an explicit map of the environment. The proposed navigation model is trained in a deep reinforcement learning framework based on Advantage Actor–Critic method and is able to directly translate robot observations to movement commands. We evaluate and compare the proposed navigation method with standard map-based approaches on several navigation scenarios in simulation and demonstrate that our method is able to navigate the robot also without the map or when the map gets corrupted, while the standard approaches fail. We also show that our method can be directly transferred to a real robot.Keywords
This publication has 14 references indexed in Scilit:
- Collision Avoidance for Indoor Service Robots Through Multimodal Deep Reinforcement Learning2019
- The -learning obstacle avoidance algorithm based on EKF-SLAM for NAO autonomous walking under unknown environmentsRobotics and Autonomous Systems, 2015
- Human-level control through deep reinforcement learningNature, 2015
- A Deterministic Improved Q-Learning for Path Planning of a Mobile RobotIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2013
- Reinforcement based mobile robot navigation in dynamic environmentRobotics and Computer-Integrated Manufacturing, 2011
- Planning and acting in partially observable stochastic domainsArtificial Intelligence, 1998
- Markov Decision Processes1994
- Self-improving reactive agents based on reinforcement learning, planning and teachingMachine Learning, 1992
- Q-learningMachine Learning, 1992
- On the Representation and Estimation of Spatial UncertaintyThe International Journal of Robotics Research, 1986