Value Distribution DDPG With Dual-Prioritized Experience Replay for Coordinated Control of Coal-Fired Power Generation Systems
- 12 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (6) , 8181-8194
Abstract
The grid connection of renewable energy poses challenges to the coordinated control of coal-fired power generation systems. Model uncertainty makes model-driven methods less effective due to the lack of adaptive capability. Large inertia of thermal process leads to local aggregation of state information, and the direct grafting reinforcement learning methods will affect the learning efficiency due to insufficient data utilization. To this end, this article proposes dual-prioritized experience replay value distribution deep deterministic policy gradient (DPER-VDP3G) algorithm. Value distribution is introduced to reflect the influence of model uncertainty on the evaluation of coordinated control policy, thus improving the accuracy of prediction cost function. The DPER is designed to reduce the nonuniform sampling bias and remove redundant data to enhance sample diversity. Comparative experiments demonstrate the advantages of the proposed method for improving network training efficiency, ameliorating load tracking accuracy and speed, and reducing energy consumption.Keywords
Funding Information
- National Natural Science Foundation of China (62303469, 62073327, 62273350, 62303468)
- Natural Science Foundation of Jiangsu Province (BK20221112, BK20221116)
- Key Research and Development Projects in Shanxi Province (202202100401002)
This publication has 36 references indexed in Scilit:
- A dynamic nonlinear model used for controller design of a 600 MW supercritical circulating fluidized bed boiler-turbine unitApplied Thermal Engineering, 2022
- Application of fast adaptive moth-flame optimization in flexible operation modeling for supercritical unitEnergy, 2022
- Modular production control using deep reinforcement learning: proximal policy optimizationJournal of Intelligent Manufacturing, 2021
- A dynamic mathematical model for once-through boiler-turbine units with superheated steam temperatureApplied Thermal Engineering, 2020
- Zone economic model predictive control of a coal-fired boiler-turbine generating systemChemical Engineering Research and Design, 2020
- Practical disturbance rejection control for boiler-turbine unit with input constraintsApplied Thermal Engineering, 2019
- CasADi: a software framework for nonlinear optimization and optimal controlMathematical Programming Computation, 2018
- Dynamic modeling, simulation and optimization of a subcritical steam power plant. Part I: Plant model and regulatory controlEnergy Conversion and Management, 2017
- An improved coordinated control strategy for boiler-turbine units supplemented by cold source flow adjustmentEnergy, 2015
- Hierarchical optimization of boiler–turbine unit using fuzzy stable model predictive controlControl Engineering Practice, 2014