Incorporating Attention Mechanism into Long Short-Term Memory Reinforcement Learning for Renewable Energy Bidding and Battery Control
Open Access
- 11 May 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (10) , 2043
Abstract
Various renewable energy sources, along with corresponding large-scale batteries, have been integrated into power grids, making renewable energy bidding and battery control critical in the real-time energy market. However, most bidding and control problems have been studied separately despite their accompanying impact on the total profit of renewable energy producers. Recently, a Reinforcement Learning (RL) strategy has been proposed to investigate renewable energy bidding and battery control jointly. It determines bidding values based on the battery’s error compensability and then applies additional battery control to the energy arbitrage process. Based on the same experimental scenarios, we present a method that incorporates the attention mechanism into long short-term memory reinforcement learning to increase total profits. We also consider various settings for our models to conduct a comprehensive survey. According to the experimental results, our method achieves significant performance gains over existing strategies, producing cumulative profits of over 400 k for solar energy and more than 200 k for wind energy. These results highlight the superior ability to balance real-time bidding precision and battery utilization efficiency, leading to higher profitability and stability in renewable energy market participation.Keywords
Funding Information
- National Science and Technology Council (112-2221-E-035-062-MY3)
This publication has 20 references indexed in Scilit:
- Multi-agent deep reinforcement learning-based cooperative energy management for regional integrated energy system incorporating active demand-side managementEnergy, 2025
- Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildingsApplied Energy, 2023
- Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learningEnergy, 2022
- DeepComp: Deep reinforcement learning based renewable energy error compensable forecastingApplied Energy, 2021
- Robust MPC-based bidding strategy for wind storage systems in real-time energy and regulation marketsInternational Journal of Electrical Power & Energy Systems, 2021
- A deep reinforcement learning method for managing wind farm uncertainties through energy storage system control and external reserve purchasingInternational Journal of Electrical Power & Energy Systems, 2020
- Operational solar forecasting for the real-time marketInternational Journal of Forecasting, 2019
- Market bidding strategy of the microgrids considering demand response and energy storage potential flexibilitiesIET Generation, Transmission & Distribution, 2019
- Deep Reinforcement Learning2019
- Accurate electrical battery model capable of predicting runtime and I-V performanceIEEE Transactions on Energy Conversion, 2006