A Transformer-Initialized Dual-Population Evolution for Large-Scale Task Scheduling in Heterogeneous Distributed Systems
- 12 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 22 (4) , 3483-3494
Abstract
Task scheduling in heterogeneous distributed systems is critical for industrial platforms, where decisions must be made under strict time constraints while resource states evolve dynamically. Existing approaches face significant limitations: classical heuristics yield suboptimal solutions; metaheuristics scale poorly; learning-based methods require extensive training with limited generalization. This article proposes a transformer-initialized dual-population evolution (TIDE), integrating three innovations: first, enhanced graph coloring preprocessing for enriched task representation, second, Transformer-based cross-modal attention for intelligent initialization of feasible solutions without offline pretraining, supported by an online adaptation mechanism, and third, asymmetric dual-population cooperative optimization with adaptive dimensionality reduction. Comprehensive experiments demonstrate that TIDE consistently outperforms state-of-the-art metaheuristics by 8%–13% in makespan while achieving an 80%–85% reduction in algorithm computing time compared to the metaheuristic average. On real scientific workflows, TIDE improves resource utilization by 4%–6% and maintains load balance above 94%, while maintaining response times within industrial deadlines. These results establish TIDE as a scalable solution for real-time scheduling in large-scale industrial systems.Keywords
This publication has 17 references indexed in Scilit:
- Enhanced multi-objective scheduling for heterogeneous computing platforms using hybrid MOEAD with SA and TS-guided initialization strategiesThe Journal of Supercomputing, 2025
- Multiobjective optimization deep reinforcement learning for dependent task scheduling based on spatio-temporal fusion graph neural networkEngineering Applications of Artificial Intelligence, 2025
- Deep Reinforcement Learning-based Multi-Objective Scheduling for Distributed Heterogeneous Hybrid Flow Shops with Blocking ConstraintsEngineering, 2024
- A method for simultaneously implementing trajectory planning and DAG task scheduling in multi-UAV assisted edge computingAd Hoc Networks, 2024
- Dynamic deadline constrained multi-objective workflow scheduling in multi-cloud environmentsExpert Systems with Applications, 2024
- A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setupsJournal of Intelligent Manufacturing, 2024
- A novel multi-objective optimized DAG task scheduling strategy for fog computing based on container migration mechanismWireless Networks, 2024
- Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learningJournal of Manufacturing Systems, 2022
- A third generation genetic algorithm NSGAIII for task scheduling in cloud computingJournal of King Saud University Computer and Information Sciences, 2022
- Performance-effective and low-complexity task scheduling for heterogeneous computingIEEE Transactions on Parallel and Distributed Systems, 2002