A Collaborative Scheduling Approach for Sheet Metal Workshops in Printing Equipment Ovens Based on Graph Attention Reinforcement Learning
Open Access
Abstract
To address the collaborative optimization problem caused by the strong coupling between 2D sheet metal nesting and flexible shop floor scheduling in the sheet metal manufacturing process for color-separation ovens of satellite-type flexographic printing presses, this paper proposes a collaborative optimization method for nesting and scheduling based on a dual-flow graph attention network and proximal policy optimization. This problem involves inherent structural and resource symmetry in manufacturing operations and is further complicated by process precedence constraints, multi-resource competition, human–machine collaboration, assembly dependencies, and the dynamic coupling between nesting decisions and downstream production takt. Based on the composition of oven components and actual production methods, a collaborative optimization model integrating nesting and scheduling was constructed; a discrete-event simulation-driven joint scheduling environment was established to uniformly model the nesting, cutting, flexible machining, and assembly processes. On this basis, the collaborative nesting–scheduling process was formalized as a Markov decision process, clearly defining the state space, action space, reward function, and state transition mechanism. To enhance the state representation capabilities of the reinforcement learning agent in a high-dimensional discrete action space and under strongly constrained dynamic scheduling scenarios, this paper embeds a dual-stream graph attention network into the PPO framework to develop the DS-GAT-PPO algorithm. This algorithm simultaneously captures spatial nesting relationships among parts as well as temporal dynamic features such as equipment load, worker fatigue, and production takt time, thereby generating feasible and efficient joint scheduling plans. Experimental results show that the proposed method can reduce completion time by approximately 10.9–33.8% while maintaining a high sheet utilization rate; in a comparison of reinforcement learning algorithms, the proposed method achieved better completion times in most test cases and reduced the number of convergence steps by approximately 6.67–66.67%, validating its effectiveness in improving solution quality, convergence efficiency, and scheduling stability. These findings provide a foundation for further research and practical applications of collaborative nesting–scheduling optimization in dynamic manufacturing environments.Keywords
Funding Information
- Xi’an University of Technology (252072501)
- Key Research and Development Program of Weinan City (202525ZDYFGY-03)
- National Key Research and Development Program of China (2023YFB3308800)
This publication has 44 references indexed in Scilit:
- An end-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problem considering multi-skilled worker constraintsJournal of Intelligent Manufacturing, 2026
- Reinforcement learning in dynamic job shop scheduling: a comprehensive review of AI-driven approaches in modern manufacturingJournal of Intelligent Manufacturing, 2025
- Adaptive optimization of cutting parameters in milling industry considering dynamic tool wear in intelligent manufacturing driven by reinforcement learningThe International Journal of Advanced Manufacturing Technology, 2024
- Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directionsArtificial Intelligence Review, 2024
- Task reallocation of human-robot collaborative production workshop based on a dynamic human fatigue modelComputers & Industrial Engineering, 2023
- A parallel hybrid PSO-GA algorithm for the flexible flow-shop scheduling with transportationComputers & Industrial Engineering, 2022
- An efficient two-stage genetic algorithm for a flexible job-shop scheduling problem with sequence dependent attached/detached setup, machine release date and lag-timeComputers & Industrial Engineering, 2020
- Production scheduling and lot streaming at flexible job-shops environments using constraint programmingComputers & Industrial Engineering, 2019
- A multi-objective cellular grey wolf optimizer for hybrid flowshop scheduling problem considering noise pollutionApplied Soft Computing, 2019
- Routing and scheduling in a flexible job shop by tabu searchAnnals of Operations Research, 1993