Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
Preprint
Abstract
With large-scale integration of renewable generation and distributed energy resources, modern power systems are confronted with new operational challenges, such as growing complexity, increasing uncertainty, and aggravating volatility. Meanwhile, more and more data are becoming available owing to the widespread deployment of smart meters, smart sensors, and upgraded communication networks. As a result, data-driven control techniques, especially reinforcement learning (RL), have attracted surging attention in recent years. This paper provides a comprehensive review of various RL techniques and how they can be applied to decision-making and control in power systems. In particular, we select three key applications, i.e., frequency regulation, voltage control, and energy management, as examples to illustrate RL-based models and solutions. We then present the critical issues in the application of RL, i.e., safety, robustness, scalability, and data. Several potential future directions are discussed as well.Keywords
All Related Versions
This publication has 108 references indexed in Scilit:
- On the sample complexity of actor-critic method for reinforcement learning with function approximationMachine Learning, 2023
- A graph policy network approach for Volt-Var Control in power distribution systemsApplied Energy, 2022
- Model-predictive control and reinforcement learning in multi-energy system case studiesApplied Energy, 2021
- Gym-ANM: Reinforcement learning environments for active network management tasks in electricity distribution systemsEnergy and AI, 2021
- Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms2021
- Safe deep reinforcement learning-based constrained optimal control scheme for active distribution networksApplied Energy, 2020
- Reinforcement learning in sustainable energy and electric systems: a surveyAnnual Reviews in Control, 2020
- (Deep) Reinforcement learning for electric power system control and related problems: A short review and perspectivesAnnual Reviews in Control, 2019
- Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systemsAutomatica, 2014
- Batch Reinforcement Learning2012