Reinforcement Learning-Based Optimization for Electric Vehicle Dispatch in Renewable Energy Integrated Power Systems
Authors:
- 20 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1297-1304
Abstract
In recent decades, modern power systems have seen a significant increase in the integration of renewable energy resources. These changes bring numerous benefits, including mitigating climate change and accelerating the transition to a low-carbon economy. However, the inherent instability of renewable energy sources presents new challenges for both the planning and operation of power systems. Traditionally, many scientific studies have focused on developing model-based optimization methods for electric vehicle (EV) dispatch problems. However, these methods often fall short in effectively handling the highly dynamic and stochastic nature of power systems due to their complexity. Reinforcement learning (RL), a model-free approach, offers a solution by capturing various uncertainties through extensive interactions with the environment and adapting to diverse state conditions in real-time. As such, reinforcement learning algorithms are well-suited for addressing EV dispatch problems. EVs can participate in vehicle-to-grid (V2G) operations, where they charge from the grid and discharge power back into it, providing valuable ancillary services such as overload reduction and energy imbalance management. Optimizing the scheduling of EV charging and discharging is crucial for maximizing the benefits to EV owners. Given the fluctuating electricity prices driven by the unstable nature of renewable energy sources, various RL algorithms, including Proximal Policy Optimization (PPO), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), will be applied to V2G problems to minimize electricity costs for EV owners.Keywords
This publication has 8 references indexed in Scilit:
- Reinforcement learning for electric vehicle applications in power systems:A critical reviewRenewable and Sustainable Energy Reviews, 2022
- Optimal vehicle-to-grid control for supplementary frequency regulation using deep reinforcement learningElectric Power Systems Research, 2022
- An autonomous control technology based on deep reinforcement learning for optimal active power dispatchInternational Journal of Electrical Power & Energy Systems, 2022
- Electric Vehicle Charging Management Based on Deep Reinforcement LearningJournal of Modern Power Systems and Clean Energy, 2022
- Human-level control through deep reinforcement learningNature, 2015
- Optimal charging of an electric vehicle using a Markov decision processApplied Energy, 2014
- Optimizing Electric Vehicle Charging: A Customer's PerspectiveIEEE Transactions on Vehicular Technology, 2013
- Optimal Operation of Plug-In Electric Vehicles in Power Systems With High Wind Power PenetrationsIEEE Transactions on Sustainable Energy, 2013