Structure-Aware Stochastic Storage Management in Smart Grids
- 8 August 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 8 (6) , 1098-1110
Abstract
Demand-side management has been proposed as an important solution for improving the energy consumption efficiency in smart grids. However, traditional pricing-based demand-side management methods usually rely on the assumption that the statistics of the system dynamics (e.g., the time-varying electricity price, the arrival distribution of consumers' demanded load) are known a priori, which does not hold in practice. In this paper, we propose a novel price-aware energy storage management algorithm for consumption scheduling which, unlike previous works, can operate optimally in systems where such statistical knowledge is unknown. We consider a power grid system where each consumer is equipped with an electrical energy storage device. Each consumer proactively determines how much energy to purchase from the energy producers by taking into consideration the time-varying and a priori unknown system dynamics, in order to maximize its own energy consumption utility. We first formulate the real-time energy storage management and demand response of the consumers as a Markov decision process and then propose an online learning algorithm that enables the consumers to learn the unknown system dynamics on-the-fly and have their energy storage management policies converge to the optimum. Our simulation results validate the efficacy of our algorithm, which helps consumers achieve higher average utility as opposed to other state-of-the-art online learning algorithms and energy storage management algorithms.Keywords
This publication has 25 references indexed in Scilit:
- Optimal demand response with energy storage management2012
- Optimal pricing for residential demand response: A stochastic optimization approach2012
- A multi-layer market for vehicle-to-grid energy trading in the smart grid2012
- Optimal sizing of energy storage for efficient integration of renewable energy2011
- The Impact of Charging Plug-In Hybrid Electric Vehicles on a Residential Distribution GridIEEE Transactions on Power Systems, 2009
- Residential implementation of critical-peak pricing of electricityEnergy Policy, 2007
- Models for mid-term electricity demand forecasting incorporating weather influencesEnergy, 2006
- The Long-Run Efficiency of Real-Time Electricity PricingThe Energy Journal, 2005
- Optimal electricity supply bidding by Markov decision processIEEE Transactions on Power Systems, 2000
- The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement LearningSIAM Journal on Control and Optimization, 2000