Mobile Robot Navigation Using Reinforcement Learning in Unknown Environments
Open Access
- 30 July 2019
- journal article
- Published by Balkan Journal of Electrical & Computer Engineering (BAJECE) in Balkan Journal of Electrical and Computer Engineering
- Vol. 7 (3) , 235-244
Abstract
In mobile robotics, navigation is considered as one of the most primary tasks, which becomes more challenging during local navigation when the environment is unknown. Therefore, the robot has to explore utilizing the sensory information. Reinforcement learning (RL), a biologically-inspired learning paradigm, has caught the attention of many as it has the capability to learn autonomously in an unknown environment. However, the randomized behavior of exploration, common in RL, increases computation time and cost, hence making it less appealing for real-world scenarios. This paper proposes an informed-biased softmax regression (iBSR) learning process that introduce a heuristic-based cost function to ensure faster convergence. Here, the action-selection is not considered as a random process, rather, is based on the maximum probability function calculated using softmax regression. Through experimental simulation scenario for navigation, the strength of the proposed approach is tested and, for comparison and analysis purposes, the iBSR learning process is evaluated against two benchmark algorithms.Keywords
This publication has 15 references indexed in Scilit:
- Mind the gap: detection and traversability analysis of terrain gaps using LIDAR for safe robot navigationRobotica, 2013
- Navigation of mobile robots in the presence of obstaclesAdvances in Engineering Software, 2010
- Artificial Intelligence Search Algorithms2009
- Outdoor Navigation of a Mobile Robot Using Differential GPS and Curb DetectionProceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (cat. No.01ch37164), 2007
- A Neural Network Approach to Complete Coverage Path PlanningIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2004
- Reinforcement learning of goal-directed obstacle-avoiding reaction strategies in an autonomous mobile robotRobotics and Autonomous Systems, 1995
- A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learningIEEE Transactions on Systems, Man, and Cybernetics, 1995
- Associative search network: A reinforcement learning associative memoryBiological Cybernetics, 1981
- A Markovian Decision ProcessIndiana University Mathematics Journal, 1957
- Some Problems in the Theory of Dynamic ProgrammingEconometrica, 1954