Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
Top Cited Papers
- 25 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Smart Grid
- Vol. 13 (4) , 2935-2958
Abstract
With large-scale integration of renewable generation and distributed energy resources, modern power systems are confronted with new operational challenges, such as growing complexity, increasing uncertainty, and aggravating volatility. Meanwhile, more and more data are becoming available owing to the widespread deployment of smart meters, smart sensors, and upgraded communication networks. As a result, data-driven control techniques, especially reinforcement learning (RL), have attracted surging attention in recent years. This paper provides a comprehensive review of various RL techniques and how they can be applied to decision-making and control in power systems. In particular, we select three key applications, i.e., frequency regulation, voltage control, and energy management, as examples to illustrate RL-based models and solutions. We then present the critical issues in the application of RL, i.e., safety, robustness, scalability, and data. Several potential future directions are discussed as well.Keywords
All Related Versions
Funding Information
- NSF CAREER (ECCS-1553407)
- NSF AI Institute (2112085)
- NSF (ECCS-1931662, AitF-1637598, CNS-1518941)
- Cyber-Physical Systems (ECCS-1932611)
- Resnick Sustainability Institute for Science, Energy and Sustainability, California Institute of Technology
- PIMCO Fellowship
- Amazon AI4Science Fellowship
- Caltech Center for Autonomous Systems and Technologies
This publication has 134 references indexed in Scilit:
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Reinforcement Learning Strategies for Clinical Trials in Nonsmall Cell Lung CancerBiometrics, 2011
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Robust Reinforcement LearningNeural Computation, 2005
- Reinforcement Learning for Reactive Power ControlIEEE Transactions on Power Systems, 2004
- Long Short-Term MemoryNeural Computation, 1997
- An analysis of temporal-difference learning with function approximationIEEE Transactions on Automatic Control, 1997
- Asynchronous stochastic approximation and Q-learningMachine Learning, 1994
- Q-learningMachine Learning, 1992
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951