YGYuan Gao

Yuan Gao

*This is an algorithmically generated author record based on publicly available information.

Yuan Gao has a total of 7 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • A Control Strategy Based on Deep Reinforcement Learning Under the Combined Wind-Solar Storage System

    by Shiying Huang, Peng Li, Ming Yang, Yuan Gao, Jiangyang Yun, Changhang Zhang

    In a deregulated environment, the renewable energy producers will face the challenge of how to increase their revenues under uncertainties of power generation and time-varying electricity price. In traditional power network scheduling, prediction and optimization are two independent processes, which easily leads to information loss and modeling error. To deal with the uncertainty and realize an end-to-end controller, this article proposes an energy storage system control model (ESSCM) in the scene of the combined wind-solar storage system. The proposed ESSCM using deep reinforcement learning (DRL) algorithm is trained by interacting with the massive environment of a power grid without requiring the assumption on the uncertainties. It learns from scratch to realize the coordination operation of with wind power and photovoltaic power in a combined system, further maximize the benefits of the combined system in the electricity market. One state-of-the-art DRL algorithm, namely double deep Q-network, is used to formulate the proposed ESSCM. Numerical results illustrate that the proposed approach can effectively accommodate the uncertainty and bring high revenues to the combined system.


  • Deep Reinforcement Learning Based Optimal Schedule for a Battery Swapping Station Considering Uncertainties

    by Yuan Gao, Jia Jun Yang, Ming Yang, Zhengshuo Li

    For a battery swapping station (BSS), the stochastic operation of electric buses (EBs) and the uncertainty of electricity prices cause unnecessary economic losses. To minimize the operating costs of the BSS, this paper applies the deep reinforcement learning (DRL) and proposes a BSS model to determine the optimal real-time charge/discharge power of the charging piles. The predictability of bus operation and the uncertainty of price can be directly captured from historical data without any assumption in the model. Moreover, Deep Deterministic Policy Gradient (DDPG), as the DRL algorithm, is implemented in the model to simultaneously control multiple charging piles. Numerical results illustrate that the proposed approach can bring less operating cost than the existing benchmark control methods for a BSS while providing adequate batteries ready for swapping.