Multi-Timescale Voltage Control Method Using Limited Measurable Information with Explainable Deep Reinforcement Learning
Open Access
Abstract
The integration of photovoltaic (PV) power generation systems has significantly increased the complexity of voltage distribution in power grids, making it challenging for conventional Load Ratio Control Transformers (LRTs) to manage voltage fluctuations caused by weather-dependent PV output variations. Power Conditioning Systems (PCSs) interconnected with PV installations are increasingly considered for voltage control to address these challenges. This study proposes a Machine Learning (ML)-based control method for sub-transmission grids, integrating long-term LRT tap-changing with short-term reactive power control of PCSs. The approach estimates the voltage at each grid node using a Deep Neural Network (DNN) that processes measurable substation data. Based on these estimated voltages, the method determines optimal LRT tap positions and PCS reactive power outputs using Deep Reinforcement Learning (DRL). This enables real-time voltage monitoring and control using only substation measurements, even in grids without extensive sensor installations, ensuring all node voltages remain within specified limits. To improve the model’s transparency, Shapley Additive Explanation (SHAP), an Explainable AI (XAI) technique, is applied to the DRL model. SHAP enhances interpretability and confirms the effectiveness of the proposed method. Numerical simulations further validate its performance, demonstrating its potential for effective voltage management in modern power grids.Keywords
This publication has 34 references indexed in Scilit:
- Key technologies in photovoltaic power generation systemsJournal of Physics: Conference Series, 2024
- Fast power flow calculation method for power system based on heterogeneous edge graph convolutional neural networkJournal of Physics: Conference Series, 2024
- Analysis of the impact of distributed photovoltaic grid integration on distribution network voltageJournal of Physics: Conference Series, 2024
- Multi-Timescale Voltage and Reactive Power Control Method Combining Fast PV PCS and Slow Transformer Tap Response Using Deep Reinforcement Learning2023
- Explainable Artificial Intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunitiesEnergy and AI, 2022
- Deep Reinforcement Learning for Volt/VAR Control in Distribution Systems: A Review2022
- Optimization of Var-Voltage Regulation Control Strategy for Grid-Connected Inverter of Photovoltaic PowerIOP Conference Series: Earth and Environmental Science, 2021
- Reactive PowerControl of Grid-Connected Photovoltaic Power GenerationJournal of Physics: Conference Series, 2021
- Gaining Insight Into Solar Photovoltaic Power Generation Forecasting Utilizing Explainable Artificial Intelligence ToolsIEEE Access, 2020
- Voltage reduction due to reverse power flow in distribution feeder with photovoltaic systemInternational Journal of Electrical Power & Energy Systems, 2019