Reinforcement-Learning-Based Route Generation for Heavy-Traffic Autonomous Mobile Robot Systems
Open Access
Abstract
Autonomous mobile robots (AMRs) are increasingly used in modern intralogistics systems as complexity and performance requirements become more stringent. One way to increase performance is to improve the operation and cooperation of multiple robots in their shared environment. The paper addresses these problems with a method for off-line route planning and on-line route execution. In the proposed approach, pre-computation of routes for frequent pick-up and drop-off locations limits the movements of AMRs to avoid conflict situations between them. The paper proposes a reinforcement learning approach where an agent builds the routes on a given layout while being rewarded according to different criteria based on the desired characteristics of the system. The results show that the proposed approach performs better in terms of throughput and reliability than the commonly used shortest-path-based approach for a large number of AMRs operating in the system. The use of the proposed approach is recommended when the need for high throughput requires the operation of a relatively large number of AMRs in relation to the size of the space in which the robots operate.Keywords
Funding Information
- The Slovenian Research and Innovation Agency (P2-0270)
This publication has 16 references indexed in Scilit:
- Optimized directed roadmap graph for multi-agent path finding using stochastic gradient descent2020
- A fuzzy logic expert system for the automated generation of roadmaps for automated guided vehicle systems2016
- An automatic approach for the generation of the roadmap for multi-AGV systems in an industrial environment2014
- On mission-dependent coordination of multiple vehicles under spatial and temporal constraints2012
- ARMO: Adaptive road map optimization for large robot teams2011
- Coordination of industrial AGVsInternational Journal of Vehicle Autonomous Systems, 2011
- Real-time obstacle avoidance for manipulators and mobile robots2005
- Probabilistic roadmaps for path planning in high-dimensional configuration spacesIEEE Transactions on Robotics and Automation, 1996
- On multiple moving objects1986
- A Formal Basis for the Heuristic Determination of Minimum Cost PathsIEEE Transactions on Systems Science and Cybernetics, 1968