A Reinforcement Learning Embedded Surrogate Lagrangian Relaxation Method for Fast Solving Unit Commitment Problems
- 20 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Power Systems
- Vol. 40 (5) , 3806-3818
Abstract
Unit commitment problems are operation optimization problems solved by independent system operators (ISOs). These problems generally need to be solved within a limited time, and the quality of the solution can significantly impact the benefit of the power system. Due to the combinatorial complexities, quickly solving large-scale UC problems is particularly challenging and proposing an efficient solution methodology is crucial. In this paper, to accelerate solving speed, we embed reinforcement learning (RL) within the surrogate Lagrangian relaxation (SLR) framework. This approach leverages decomposition and machine learning to reduce the complexity of solving UC problems. By relaxing coupling constraints, the entire problem is decomposed into a set of sub-problems, each associated with a unit and significantly reduced in complexity. These sub-problems are then novelly formulated as Markov decision processes (MDPs), and a novel RL algorithm is used to rapidly generate high-quality feasible solutions. Our method substantially improves the overall speed of SLR and is applicable for solving large-scale UC problems. Numerical experiments on the IEEE 118-bus system and the 10K-bus system demonstrate that our method can obtain near-optimal solutions with no more than 3% performance degradation while achieving a speedup of 25$\sim$110 times compared to Gurobi, the state-of-the-practice solver.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFA1004600)
- National Natural Science Foundation of China (62125304, 62192751, 62073182)
- Beijing Natural Science Foundation (L233005)
- BNRist Project (BNR2024TD03003)
- 111 International Collaboration Project (B25027)
This publication has 40 references indexed in Scilit:
- An ultra-fast optimization algorithm for unit commitment based on neural branchingEnergy Reports, 2023
- Applying reinforcement learning and tree search to the unit commitment problemApplied Energy, 2021
- On the complexity of the Unit Commitment ProblemAnnals of Operations Research, 2018
- A fuzzy reinforcement learning approach to thermal unit commitment problemNeural Computing and Applications, 2017
- Evaluating the impact of sub-hourly unit commitment method on spinning reserve in presence of intermittent generatorsEnergy, 2016
- Convergence of the Surrogate Lagrangian Relaxation MethodJournal of Optimization Theory and Applications, 2014
- The impact of sub-hourly modelling in power systems with significant levels of renewable generationApplied Energy, 2014
- Branch and Cut2011
- Ordinal Optimization2007
- An optimization-based method for unit commitmentInternational Journal of Electrical Power & Energy Systems, 1992