Frequency Containment Reserve and Imbalance participation: a Battery-Integrated Reinforcement Learning Strategy
Open Access
- 31 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 482-483
Abstract
With the increasing integration of renewable energy sources (RES), the electrical grid is facing an amplified uncertainty in the energy supply. Transmission System Operators (TSOs) are offering remuneration in exchange for energy exchanges that reduce system imbalances. Helping stabilize the grid frequency is hence an economically viable endeavor, but it requires strategies that can properly manage stochasticities. To tackle this, we analyze the participation of grid-scale batteries in Frequency Containment Reserve (FCR) using a Reinforcement Learning (RL) control strategy. Acting in a multi-market scenario, the RL agent learns to effectively leverage imbalance prices for a high-quality energy recovery strategy. We trained the agent to maximize the imbalance settlement profit while ensuring conforming participation in the FCR service. The agent is also trained to keep the battery yearly cycles below a planned value. In our simulations, we demonstrated the efficacy of RL when dealing with different FCR participation magnitudes, obtaining an average improvement of + 9% in profit compared to a rule-based controller baseline.Keywords
Funding Information
- Flemish Government and Flanders Innovation & Entrepreneurship (VLAIO) through the Moonshot project InduFlexControl-1 (HBC.2019.0113)
- Flemish Government and Flanders Innovation & Entrepreneurship (VLAIO) through the Moonshot project InduFlexControl-2 (HBC.2021.0579)
This publication has 4 references indexed in Scilit:
- Energy recovery strategies for batteries providing frequency containment reserve in the Nordic power systemSustainable Energy, Grids and Networks, 2022
- The effect of renewable energy incorporation on power grid stability and resilienceScience Advances, 2022
- Optimum Operation of Battery Storage System in Frequency Containment Reserves MarketsIEEE Transactions on Smart Grid, 2020
- Electrical Energy Storage for the Grid: A Battery of ChoicesScience, 2011