Modified Q-Learning Algorithm for Mobile Robot Path Planning Variation using Motivation Model
Open Access
- 1 September 2023
- journal article
- research article
- Published by Universitas Muhammadiyah Yogyakarta in Journal of Robotics and Control (JRC)
- Vol. 4 (5) , 696-707
Abstract
Path planning is an essential algorithm in autonomous mobile robots, including agricultural robots, to find the shortest path and to avoid collisions with obstacles. Q-Learning algorithm is one of the reinforcement learning methods used for path planning. However, for multi-robot system, this algorithm tends to produce the same path for each robot. This research modifies the Q-Learning algorithm in order to produce path variations by utilizing the motivation model, i.e. achievement motivation, in which different motivation parameters will result in different optimum paths. The Motivated Q-Learning (MQL) algorithm proposed in this study was simulated in an area with three scenarios, i.e. without obstacles, uniform obstacles, and random obstacles. The results showed that, in the determined scenario, the MQL can produce 2 to 4 variations of optimum path without any potential of collisions (Jaccard similarity = 0%), in contrast to the Q-Learning algorithm that can only produce one optimum path variation. This result indicates that MQL can solve multi-robots path planning problems, especially when the number of robots is large, by reducing the possibility of collisions as well as decreasing the problem of queues. However, the average computational time of the MQL is slightly longer than that of the Q-Learning.Keywords
This publication has 81 references indexed in Scilit:
- A novel ant colony algorithm for solving shortest path problems with fuzzy arc weightsAlexandria Engineering Journal, 2022
- Navigation of Multiple Robots in Formative Manner in an Unknown Environment using Artificial Potential Field Based Path Planning AlgorithmAin Shams Engineering Journal, 2022
- An intelligent approach for autonomous mobile robots path planning based on adaptive neuro-fuzzy inference systemAin Shams Engineering Journal, 2022
- An Improved Q-Learning Algorithm for Path Planning in Maze Environments2020
- 3D path planning for a robot based on improved ant colony algorithmEvolutionary Intelligence, 2020
- An Algorithm for Path Planning Based on Improved Q-LearningAdvances in Intelligent Systems and Computing, 2020
- Hybrid Path Planning Based on Safe A* Algorithm and Adaptive Window Approach for Mobile Robot in Large-Scale Dynamic EnvironmentJournal of Intelligent & Robotic Systems, 2020
- Multi robot distance based formation using Parallel Genetic AlgorithmApplied Soft Computing, 2020
- A knowledge based fuzzy-probabilistic roadmap method for mobile robot navigationApplied Soft Computing, 2019
- The production data-based similarity coefficient versus Jaccard's similarity coefficientComputers & Industrial Engineering, 1991