EXARL-PARS: Parallel Augmented Random Search Using Reinforcement Learning at Scale for Applications in Power Systems
Open Access
- 20 June 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1
Abstract
With recent advances in deep learning and large-scale computing, learning-based controls have become increasingly attractive for complex physical systems. Consequently, developing generalized learning-based control software that takes into account the next generation of computing architectures is paramount. Specifically, for the case of complex control, we present the Easily eXtendable Architecture for Reinforcement Learning (EXARL), which aims to support various scientific applications seeking to leverage reinforcement learning (RL) on exascale computing architectures. We demonstrate the efficacy and performance of the EXARL library for the scientific use case of designing a complex control policy to stabilize a power system after experiencing a fault. We use a parallel augmented random search method developed within EXARL and present its preliminary validation and performance stabilization of a fault for the IEEE 39-bus system.Keywords
This publication has 13 references indexed in Scilit:
- Applications of reinforcement learning in energy systemsRenewable and Sustainable Energy Reviews, 2021
- Adaptive Power System Emergency Control Using Deep Reinforcement LearningIEEE Transactions on Smart Grid, 2019
- The Exascale Computing ProjectComputing in Science & Engineering, 2017
- An Efficient Optimal Control Method for Open-Loop Transient Stability Emergency ControlIEEE Transactions on Power Systems, 2016
- GridPACKTM: A framework for developing power grid simulations on high-performance computing platformsThe International Journal of High Performance Computing Applications, 2015
- An analysis of previous blackouts in the world: Lessons for China׳s power industryRenewable and Sustainable Energy Reviews, 2015
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Decision Tree-Based Preventive and Corrective Control Applications for Dynamic Security Enhancement in Power SystemsIEEE Transactions on Power Systems, 2010
- Blackout Prevention in the United States, Europe, and RussiaProceedings of the IEEE, 2005
- Techniques for on-line transient stability assessment and control2002