A stochastic deep reinforcement learning agent for grid-friendly electric vehicle charging management
Open Access
- 7 September 2022
- journal article
- research article
- Published by Springer Nature in Energy Informatics
- Vol. 5 (S1) , 1-14
Abstract
Electrification of the transportation sector provides several advantages in favor of climate protection and a shared economy. At the same time, the rapid growth of electric vehicles also demands innovative solutions to mitigate risks to the low-voltage network due to unpredictable charging patterns of electric vehicles. This article conceptualizes a stochastic reinforcement learning agent that learns the optimal policy for regulating the charging power. The optimization objective intends to reduce charging time, thus charging faster while minimizing the expected voltage violations in the distribution network. The problem is formulated as a two-stage optimization routine where the stochastic policy gradient agent predicts the boundary condition of the inner non-linear optimization problem. The results confirm the performance of the proposed architecture to control the charging power as intended. The article also provides extensive theoretical background and directions for future research in this discipline.Keywords
This publication has 22 references indexed in Scilit:
- A rule-based energy management scheme for uninterrupted electric vehicles charging at constant price using photovoltaic-grid systemRenewable Energy, 2018
- Policy Gradient Methods2016
- Introducing MATSim2016
- Optimal Scheduling for Electric Vehicle Charging With Discrete Charging Levels in Distribution GridIEEE Transactions on Smart Grid, 2016
- Electric Vehicle Charging on Residential Distribution Systems: Impacts and MitigationsIEEE Access, 2015
- Optimal Charging Scheduling of Electric Vehicles in Smart Grids by Heuristic AlgorithmsEnergies, 2014
- Effects of variation of temporal resolution on domestic power and solar irradiance measurements2013
- The photovoltaic Performance Modeling Collaborative (PVPMC)2012
- Optimal Charging of Electric Vehicles in Low-Voltage Distribution SystemsIEEE Transactions on Power Systems, 2011
- Voltage profile support in distribution networks — influence of the network R/X ratio2008