Efficient Reinforcement Learning of Task Planners for Robotic Palletization Through Iterative Action Masking Learning
- 8 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (11) , 9303-9310
Abstract
The development of robotic systems for palletization in logistics scenarios is of paramount importance, addressing critical efficiency and precision demands in supply chain management. This paper investigates the application of Reinforcement Learning (RL) in enhancing task planning for such robotic systems. Confronted with the substantial challenge of a vast action space, which is a significant impediment to efficiently apply out-of-the-shelf RL methods, our study introduces a novel method of utilizing supervised learning to iteratively prune and manage the action space effectively. By reducing the complexity of the action space, our approach not only accelerates the learning phase but also ensures the effectiveness and reliability of the task planning in robotic palletization. The experiemental results underscore the efficacy of this method, highlighting its potential in improving the performance of RL applications in complex and high-dimensional environments like logistics palletization.Keywords
All Related Versions
Funding Information
- InnoHK of the Government of the Hong Kong Special Administrative Region via the Hong Kong Centre for Logistics Robotics
This publication has 15 references indexed in Scilit:
- Learning practically feasible policies for online 3D bin packingScience China Information Sciences, 2021
- Robot Packing With Known Items and Nondeterministic Arrival OrderIEEE Transactions on Automation Science and Engineering, 2020
- Stable Bin Packing of Non-convex 3D Objects with a Robot Manipulator2019
- An Online Packing Heuristic for the Three-Dimensional Container Loading Problem in Dynamic Environments and the Physical Internet2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015
- MuJoCo: A physics engine for model-based control2012
- A hybrid genetic algorithm with a new packing strategy for the three-dimensional bin packing problemApplied Mathematics and Computation, 2012
- TS2PACK: A two-level tabu search for the three-dimensional bin packing problemEuropean Journal of Operational Research, 2009
- A Hybrid Genetic Algorithm for Packing in 3D with Deepest Bottom Left with Fill Method2004