Memory-based reinforcement learning algorithm for autonomous exploration in unknown environment
Authors:
Open Access
- 1 May 2018
- journal article
- research article
- Published by SAGE Publications in International Journal of Advanced Robotic Systems
- Vol. 15 (3)
Abstract
In the near future, robots would be seen in almost every area of our life, in different shapes and with different objectives such as entertainment, surveillance, rescue, and navigation. In any shape and with any objective, it is necessary for them to be capable of successful exploration. They should be able to explore efficiently and be able to adapt themselves with changes in their environment. For successful navigation, it is necessary to recognize the difference between similar places of an environment. In order to achieve this goal without increasing the capability of sensors, having a memory is crucial. In this article, an algorithm for autonomous exploration and obstacle avoidance in an unknown environment is proposed. In order to make our self-learner algorithm, a memory-based reinforcement learning method using multilayer neural network is used with the aim of creating an agent having an efficient exploration and obstacle avoidance policy. Furthermore, this agent can automatically adapt itself to the changes of its environment. Finally, in order to test the capability of our algorithm, we have implemented it in a robot similar to a real model, simulated in the robust physics engine simulator of Gazebo.Keywords
Funding Information
- Ministry of Trade, Industry & Energy (MOTIE) under the R&D progra (002428)
This publication has 8 references indexed in Scilit:
- Integrated particle swarm optimization algorithm based obstacle avoidance control design for home service robotComputers and Electrical Engineering, 2016
- Reinforcement learning based computational adaptive optimal control and system identification for linear systemsAnnual Reviews in Control, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Obstacle Avoidance Method for Wheeled Mobile Robots Using Interval Type-2 Fuzzy Neural NetworkIEEE Transactions on Fuzzy Systems, 2014
- Study of Reinforcement Learning Based Dynamic Traffic Control Mechanism2013
- Reinforcement learning for robot soccerAutonomous Robots, 2009
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Q-learningMachine Learning, 1992