A coordinated scheduling optimization method for integrated energy systems with data centres based on deep reinforcement learning
Open Access
- 5 September 2024
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Generation, Transmission & Distribution
- Vol. 18 (19) , 3071-3084
Abstract
As an emerging multi‐energy consumption subject, data centres (DCs) are bound to become crucial energy users for integrated energy systems (IES). Therefore, how to fully tap the potential of the collaborative operation between DCs and IES to improve total energy efficiency and economic performance is becoming a pressing need. In this article, the authors research an optimization coordinated by the energy scheduling and information service provision within the scenario of an integrated energy system with a data centre (IES‐DC). The mathematical model of IES‐DC is first established to reveal the energy conversion process of the electricity‐heat‐gas IES and the DC's energy consumption affected by the scale of active IT equipment. For dynamical providing multi‐energy and computing service by coordinating scheduling energy and information equipment, the formulations of IES‐DC scheduling, which is described as a Markov decision process (MDP), are presented, and it is solved by introducing the twin‐delayed deep deterministic policy gradient (TD3), which is a model‐free deep reinforcement learning (DRL) algorithm. Finally, the numerical studies show that compared with benchmarks, the proposed method based on the TD3 algorithm can effectively control the operation of energy conversion equipment and the number of active servers in IES‐DC.Keywords
Funding Information
- Science and Technology Foundation of State Grid Corporation of China (5400‐202413216A‐1‐1‐ZN)
This publication has 30 references indexed in Scilit:
- Optimal scheduling of zero-carbon integrated energy system considering long- and short-term energy storages, demand response, and uncertaintyJournal of Cleaner Production, 2023
- Cooperative operation of industrial/commercial/residential integrated energy system with hydrogen energy based on Nash bargaining theoryEnergy, 2023
- Decentralized optimization for integrated electricity–heat systems with data center based energy hub considering communication packet lossApplied Energy, 2023
- Multi-agent deep reinforcement learning-based optimal energy management for grid-connected multiple energy carrier microgridsInternational Journal of Electrical Power & Energy Systems, 2023
- Collaborative optimization scheduling of integrated energy system considering user dissatisfactionEnergy, 2023
- Coordinated optimal scheduling of integrated energy system for data center based on computing load shiftingEnergy, 2022
- Integrated energy systems of data centers and smart grids: State-of-the-art and future opportunitiesApplied Energy, 2021
- Integrated planning of internet data centers and battery energy storage systems in smart gridsApplied Energy, 2021
- Deep convolutional neural network based fractional-order terminal sliding-mode control for robotic manipulatorsNeurocomputing, 2020
- Ensuring renewable energy utilization with quality of service guarantee for energy-efficient data center operationsApplied Energy, 2020