Brain-Inspired Deep Meta-Reinforcement Learning for Active Coordinated Fault-Tolerant Load Frequency Control of Multi-Area Grids
Authors:
- 3 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 21 (3) , 2518-2530
Abstract
This paper proposes an active coordinated fault tolerance load frequency control (AFCT-LFC) method, which effectively prevents sudden frequency changes caused by unit actuator failures or unplanned decommissioning in a multi-area interconnected grid subject to the performance-based frequency regulation market mechanism. It can also reduce regulation mileage payments and achieve multi-objective active fault-tolerant control. In addition, this paper proposes a brain-Inspired deep meta-deterministic policy gradient algorithm (BIMA-DMDPG), which adopts multi-agent centralized training, equates the controller of each area as an agent capable of independent decision making, and implements distributed training by dividing the environment into multiple environments. In addition, meta-reinforcement learning is employed to realize multi-task collaborative learning. The optimal policy is actively selected under different fault conditions to achieve active fault-tolerant control. The superior performance of the method is verified in a four-area LFC model of the China Southern Grid (CSG), in which it is tested alongside a selection of existing algorithms. Note to Practitioners —AFCT-LFC is based on advanced artificial intelligence algorithm, which can effectively identify any fault in multi-area grids and make rapid response to achieve active fault-tolerant control. Compared with the existing model-based fault-tolerant control methods, the BIMA-DMDPG algorithm proposed in this paper does not need to rely on accurate mathematical models, and can be applied to practice through simple training, which is very suitable for practical applications. Therefore, AFCT-LFC is an advanced adaptive active fault-tolerant control method that can be truly applied in practice because of its fast-decision-making ability and performance.Keywords
Funding Information
- National Natural Science Foundation of China (52177185)
This publication has 23 references indexed in Scilit:
- Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learningApplied Energy, 2022
- A Temporal–Spatial Deep Learning Approach for Driver Distraction Detection Based on EEG SignalsIEEE Transactions on Automation Science and Engineering, 2021
- Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy systemApplied Energy, 2021
- A Penalty Scheme for Mitigating Uninstructed Deviation of Generation Outputs From Variable Renewables in a Distribution MarketIEEE Transactions on Smart Grid, 2020
- A distributional code for value in dopamine-based reinforcement learningNature, 2020
- Smart generation control based on multi-agent reinforcement learning with the idea of the time tunnelEnergy, 2018
- Accelerating bio-inspired optimizer with transfer reinforcement learning for reactive power optimizationKnowledge-Based Systems, 2017
- A wolf pack hunting strategy based virtual tribes control for automatic generation control of smart gridApplied Energy, 2016
- Stochastic Optimal Relaxed Automatic Generation Control in Non-Markov Environment Based on Multi-Step $Q(\lambda)$ LearningIEEE Transactions on Power Systems, 2011
- Adaptive decentralized load frequency control of multi-area power systemsInternational Journal of Electrical Power & Energy Systems, 2005