A Deep Reinforcement Learning Dispatch Method for Integrated Energy Systems Considering Data Center Computing-Power
Open Access
- 22 September 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (19) , 4363
Abstract
With the rapid development of the digital economy, the construction scale of data centers continues to expand. Given the substantial heat generated by their high electricity consumption, data centers have become critical components of integrated energy systems, exhibiting computing–electricity–heat multi-energy coupling characteristics. This coupling necessitates the coordinated dispatch of multiple devices and the simultaneous optimization of multiple objectives. To address this challenge, this paper proposes the CA-CPEn-TD3 algorithm to solve the optimal dispatch problem of a data-center-based integrated energy system. First, an integrated energy system model is established, in which the computing-load-shifting capability of the computing center is considered. By jointly accounting for computing, electricity, heat, and environmental costs, a reinforcement learning optimization objective is formulated. On this basis, building upon the TD3 framework, a constraint-aware action projection mechanism is introduced to effectively prevent violations of hard constraints and to yield more feasible and practical dispatch strategies. In addition, curriculum learning, parallel exploration, and an ensemble decision-making mechanism are incorporated to enhance training stability. Case studies verify that the proposed algorithm effectively provides deployable dispatch strategies and achieves economically efficient and environmentally friendly scheduling amid the continuous expansion of data centers.Keywords
This publication has 17 references indexed in Scilit:
- Harnessing dynamic carbon intensity for energy-data co-optimization in internet data centersRenewable Energy, 2025
- A review of integrated energy system modeling and operationApplied Energy, 2025
- Comprehensive evaluation of all-element flexibility resources in data centers: considering synergistic benefits of computing, electricity, and heatApplied Energy, 2025
- An adaptive robust planning method for data center micro-energy system towards flexibility enhancementRenewable Energy Focus, 2025
- Research on collaborative scheduling of internet data center and regional integrated energy system based on electricity-heat-water couplingEnergy, 2024
- Integrated energy systems of data centers and smart grids: State-of-the-art and future opportunitiesApplied Energy, 2021
- Deep Reinforcement Learning for Stochastic Dynamic Microgrid Energy Management2021
- Deep reinforcement learning for energy management in a microgrid with flexible demandSustainable Energy, Grids and Networks, 2021
- HSOS: a novel hybrid algorithm for solving the transient-stability-constrained OPF problemSoft Computing, 2019
- Transient Stability Constrained Optimal Power Flow by Particle Swarm Optimization with Time Varying Acceleration Coefficients2019