MQL-MM: A Meta-Q-Learning-Based Multiobjective Metaheuristic for Energy-Efficient Distributed Fuzzy Hybrid Blocking Flow-Shop Scheduling Problem
- 10 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Evolutionary Computation
- Vol. 29 (4) , 1183-1198
Abstract
Since severe environmental problem in manufacturing industries is becoming increasingly prominent, energy-efficient production scheduling has gained more and more attentions. This paper studies an energy-efficient distributed fuzzy hybrid blocking flow-shop scheduling problem (EEDFHBFSP), where processing time and setup time are uncertain. The objective is to minimize fuzzy makespan and total fuzzy energy consumption simultaneously. To solve such problem, a mixed-integer linear programming model is firstly presented to format it. Then, a meta-Q-learning-based multi-objective metaheuristic (MQL-MM) is proposed. In MQL-MM, a machine-position-based dispatch rule is designed as the decoding scheme. A decomposition-based constructive heuristic is employed to generate the initial population with high quality and diversity. Several problem-specific search operators are developed to explore and exploit the solution space. A meta-Q-learning-based multi-objective search framework is presented to guide the using of search operators, which includes a meta-training phase and an adaptive search phase. The meta-training phase is employed to train the search operators to construct the Q-learning model. The adaptation search phase utilizes such model to conduct the automatic selection of the search operators. Moreover, an energy saving strategy is designed to improve the candidate solutions. Finally, we conduct extensive experiments. The experimental results show that the designs of MQL-MM are effective, and MQL-MM performs better than several well-performing methods on solving EEDFHBFSP.Keywords
Funding Information
- National Natural Science Foundation of China (62003203, 62103195, 62273219)
- Natural Science Foundation of Jiangsu Province (BK20210558)
- China Postdoctoral Science Foundation (2021M701700, 2023M732166)
- Fundamental Research Funds for the Central Universities (GK202201014)
- Open Project Fund of Key Laboratory of Numerical Simulation for Large Scale Complex Systems, Ministry of Education, China (202404)
This publication has 51 references indexed in Scilit:
- A multi-neighborhood-based multi-objective memetic algorithm for the energy-efficient distributed flexible flow shop scheduling problemNeural Computing and Applications, 2022
- Learning to select operators in meta-heuristics: An integration of Q-learning into the iterated greedy algorithm for the permutation flowshop scheduling problemEuropean Journal of Operational Research, 2022
- Machine learning at the service of meta-heuristics for solving combinatorial optimization problems: A state-of-the-artEuropean Journal of Operational Research, 2022
- A cooperated shuffled frog-leaping algorithm for distributed energy-efficient hybrid flow shop scheduling with fuzzy processing timeComplex & Intelligent Systems, 2021
- Energy-efficient scheduling in manufacturing companies: A review and research frameworkEuropean Journal of Operational Research, 2016
- Multi-objective sequence dependent setup times permutation flowshop: A new algorithm and a comprehensive studyEuropean Journal of Operational Research, 2013
- The hybrid flow shop scheduling problemEuropean Journal of Operational Research, 2010
- Fuzzy job shop scheduling problem with availability constraintsComputers & Industrial Engineering, 2010
- A simple and effective iterated greedy algorithm for the permutation flowshop scheduling problemEuropean Journal of Operational Research, 2007
- Q-learningMachine Learning, 1992