On-Line Optimization of Microgrid Operating Cost Based on Deep Reinforcement Learning
Authors:
- S H LinSLS H Lin
- H H YuHYH H Yu
- H W ChenHCH W Chen
Open Access
- 1 March 2021
- conference paper
- Published by IOP Publishing in IOP Conference Series: Earth and Environmental Science
- Vol. 701 (1)
Abstract
In view of the microgrid random optimization scheduling problem, this paper proposes a microgrid online optimization algorithm based on deep reinforcement learning. By using the approximate state-action value function of the deep neural network, the action of the battery is discretized into the decision variables output by the neural network, and then the remaining decision variables are solved by nonlinear programming and the immediate return is calculated. The optimal strategy is obtained by using the Q-learning algorithm. In order to make the neural network adapt to the randomness of wind, photovoltaic and load power, according to the wind, photovoltaic and load power prediction curves as well as wind, photovoltaic and load prediction errors, Monte Carlo sampling was used to generate multiple sets of training curves to train the neural network. After the training is completed, the weight is fixed and the real-time action value of the battery is output according to the real-time status of the microgrid, so as to realize the online optimal dispatching of the microgrid. Compared with day-ahead optimization results under different fluctuations of wind, photovoltaic and load power, the effectiveness and superiority of this algorithm in online optimization of microgrid are verified.Keywords
This publication has 4 references indexed in Scilit:
- Stochastic Optimization of Economic Dispatch for Microgrid Based on Approximate Dynamic ProgrammingIEEE Transactions on Smart Grid, 2018
- Optimized Energy Management System to Reduce Fuel Consumption in Remote Military MicrogridsIEEE Transactions on Industry Applications, 2017
- Distributed Energy Management for Networked Microgrids Using Online ADMM With RegretIEEE Transactions on Smart Grid, 2016
- Optimal Energy Management for a Residential Microgrid Including a Vehicle-to-Grid SystemIEEE Transactions on Smart Grid, 2014