Learning-Based Real-Time Aggregate Flexibility Provision and Scheduling of Electric Vehicles
- 14 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Smart Grid
- Vol. 15 (6) , 5840-5852
Abstract
It is recognized that large-scale electric vehicles (EVs) can be aggregated and behave as a controllable storage to provide flexibility for power systems. To provide high-quality services to both the system and EV users, it is critical to accurately estimate the aggregate flexibility of EVs, which is highly challenging due to the uncertainties from regulation signals and EV behaviors. Thus, this paper proposes a learning-based approach, which is model-free and online. First, the optimal aggregate flexibility provision problem is formulated as a Markov decision process (MDP). Moreover, a heuristic causal real-time scheduling policy is developed to allocate the disaggregated power to each EV. Then, a deep reinforcement learning (DRL) algorithm, which incorporates the idea of Munchausen reinforcement learning into Soft Actor-Critic method, is proposed to solve the MDP problem. In addition, an unsupervised learning stage is integrated in the algorithm for state-dimension reduction. Numerical simulation results based on the real-world dataset demonstrate that the proposed approach can effectively deal with multiple uncertainties and balance economy and user satisfaction, and its performance is superior to existing model-driven aggregation methods and DRL algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (52277107, U22A6007)
- Shenzhen Science and Technology Innovation Program (WDZC20231127152020001)
This publication has 28 references indexed in Scilit:
- Data-Driven Coordinated Charging for Electric Vehicles With Continuous Charging Rates: A Deep Policy Gradient ApproachIEEE Internet of Things Journal, 2021
- Active integration of electric vehicles into distribution grids: Barriers and frameworks for flexibility servicesRenewable and Sustainable Energy Reviews, 2021
- Smart Online Charging Algorithm for Electric Vehicles via Customized Actor–Critic LearningIEEE Internet of Things Journal, 2021
- Towards Optimality Preserving Aggregation for Scheduling Distributed Energy ResourcesIEEE Transactions on Control of Network Systems, 2021
- Forming Dispatchable Region of Electric Vehicle Aggregation in Microgrid BiddingIEEE Transactions on Industrial Informatics, 2020
- Reinforcement Learning for Real-Time Pricing and Scheduling Control in EV Charging StationsIEEE Transactions on Industrial Informatics, 2019
- Online Distributed MPC-Based Optimal Scheduling for EV Charging Stations in Distribution SystemsIEEE Transactions on Industrial Informatics, 2018
- Dynamic Scheduling for Charging Electric Vehicles: A Priority RuleIEEE Transactions on Automatic Control, 2016
- Economic MPC of Aggregating Commercial Buildings for Providing Flexible Power ReserveIEEE Transactions on Power Systems, 2014
- Demand Response for Ancillary ServicesIEEE Transactions on Smart Grid, 2013