Omniveyor: An Assembled Logistics Sorting System Powered by Reinforcement Learning
- 10 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 11982-11995
Abstract
To improve logistics efficiency, smart logistics sorting is an inevitable trend in logistics development. Existing smart logistics sorting systems suffer from high construction costs or limited scalability. To solve these problems, we design a brand-new two-dimensional conveyor system called Omniveyor, which transports and sorts high-density packages within a limited space. It is assembled from multiple repetitive square conveyor modules, achieving the goal of cost-effectiveness and easy maintenance. To realize automatic sorting, we model the planning problem on Omniveyor and propose a scheduling strategy named MMPPO by reinforcement learning. Unlike traditional path planning, MMPPO assigns actions to modules rather than packages, which reduces scheduling overhead in high-throughput scenarios. Furthermore, we develop a simulation environment to inspect the effectiveness of our method, which solves an intractable package-following problem that has plagued simulation implementation in this field. Experimental results show that MMPPO outperforms baselines in terms of throughput and overall consumption at high densities. Besides, we implement a physical prototype of Omniveyor to validate its feasibility.Keywords
Funding Information
- National Key Research and Development Program of China (2021ZD0110900)
- Key Research and Development Program of Heilongjiang Province (2022ZX01A22)
- National Natural Science Foundation of China (61972114, 62106061)
- Project of Laboratory of Advanced Agricultural Sciences of Heilongjiang Province (ZY04JD05-010)
- Natural Science Foundation of Heilongjiang Province (YQ2019F007)
This publication has 40 references indexed in Scilit:
- An improved fault-tolerant cultural-PSO with probability for multi-AGV path planningExpert Systems with Applications, 2023
- Driving line-based two-stage path planning in the AGV sorting systemRobotics and Autonomous Systems, 2023
- Combined improved A* and greedy algorithm for path planning of multi-objective mobile robotScientific Reports, 2022
- Priority inheritance with backtracking for iterative multi-agent path findingArtificial Intelligence, 2022
- Environmental and economic sustainability assessment of an industry 4.0 application: the AGV implementation in a food industryThe International Journal of Advanced Manufacturing Technology, 2022
- A literature review of smart warehouse operations managementFrontiers of Engineering Management, 2022
- Planning and control of autonomous mobile robots for intralogistics: Literature review and research agendaEuropean Journal of Operational Research, 2021
- Automated order picking systems and the links between design and performance: a systematic literature reviewInternational Journal of Production Research, 2020
- Conflict-based search for optimal multi-agent pathfindingArtificial Intelligence, 2015
- Planning Algorithms2006