Implementing Deep Reinforcement Learning-Based Grid Voltage Control in Real-World Power Systems: Challenges and Insights
Authors:
- 14 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study rigorously evaluates DRL’s performance and limitations within actual operational contexts by utilizing detailed experiments across the IEEE 14-bus system, Illinois 200-bus system, and the ISO New England node-breaker model. Our analysis critically assesses DRL’s effectiveness for grid control from a system operator's perspective, identifying specific performance bottlenecks. The findings provide actionable insights that highlight the necessity of advancing AI technologies to effectively address the growing complexities of modern power systems. This research underscores the vital role of DRL in enhancing grid management and reliability.Keywords
All Related Versions
Funding Information
- National Science Foundation
This publication has 19 references indexed in Scilit:
- Deep reinforcement learning based voltage control revisitedIET Generation, Transmission & Distribution, 2023
- Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement LearningIEEE Transactions on Power Systems, 2022
- Deep Reinforcement Learning for Cyber SecurityIEEE Transactions on Neural Networks and Learning Systems, 2021
- Resilient Operation of Distribution Grids Using Deep Reinforcement LearningIEEE Transactions on Industrial Informatics, 2021
- Improved deep reinforcement learning based convergence adjustment method for power flow calculationIET Conference Proceedings, 2021
- AI-Based Autonomous Line Flow Control via Topology Adjustment for Maximizing Time-Series ATCs2020
- A Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement LearningIEEE Transactions on Power Systems, 2020
- Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid OperationsIEEE Transactions on Power Systems, 2019
- Reinforcement Learning for Cyber-Physical Security Assessment of Power Systems2019
- Orthogonal Column Latin Hypercubes and Their Application in Computer ExperimentsJournal of the American Statistical Association, 1998