Joint Scheduling of Deferrable Demand and Storage With Random Supply and Processing Rate Limits
- 22 December 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 66 (11) , 5506-5513
Abstract
We study the joint scheduling of deferrable demands (e.g., the charging of electric vehicles) and storage systems in the presence of random supply, demand arrivals, processing costs, and subject to processing rate limit constraint. We formulate the scheduling problem as a dynamic program so as to minimize the expected total cost, the sum of processing costs, and the noncompletion penalty (incurred when a task is not fully processed by its deadline). Under mild assumptions, we characterize an optimal index-based priority rule: Tasks with less laxity should be processed first, and for two tasks with the same laxity, the task with a later deadline has the priority. Based on the established optimal control policy characterizations (on resource allocation among multitasks and storage operation), we propose to apply data-driven reinforcement learning (RL) methods to make energy procurement decisions. Numerical results show that the proposed approach significantly outperforms existing RL methods combined with the earliest deadline first priority rule (by reducing 26%–32% of system cost).Keywords
Funding Information
- Shun Hing Institute of Advanced Engineering
- Chinese University of Hong Kong and NSFC (62073182)
This publication has 33 references indexed in Scilit:
- Optimal Management and Sizing of Energy Storage Under Dynamic Pricing for the Efficient Integration of Renewable EnergyIEEE Transactions on Power Systems, 2014
- Cooperation and Storage Tradeoffs in Power Grids With Renewable Energy ResourcesIEEE Journal on Selected Areas in Communications, 2014
- Optimal Generation and Storage Scheduling in the Presence of Renewable Forecast UncertaintiesIEEE Transactions on Smart Grid, 2014
- Combining models of capacity supply to handle volatile demand: The economic impact of surplus capacity in cloud service environmentsDecision Support Systems, 2014
- A stochastic dynamic programming model for co-optimization of distributed energy storageEnergy Systems, 2013
- Fast MPC-Based Coordination of Wind Power and Battery Energy Storage SystemsJournal of Energy Engineering, 2012
- Asymptotically tight steady-state queue length bounds implied by drift conditionsQueueing Systems, 2012
- Queues in Service Systems: Customer Abandonment and Diffusion Approximations2011
- OnActor-Critic AlgorithmsSIAM Journal on Control and Optimization, 2003
- Q-learningMachine Learning, 1992