Online Learning and Distributed Control for Residential Demand Response
- 17 June 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Smart Grid
- Vol. 12 (6) , 4843-4853
Abstract
This paper studies the automated control method for regulating air conditioner (AC) loads in incentive-based residential demand response (DR). The critical challenge is that the customer responses to load adjustment are uncertain and unknown in practice. In this paper, we formulate the AC control problem in a DR event as a multi-period stochastic optimization that integrates the indoor thermal dynamics and customer opt-out status transition. Specifically, machine learning techniques including Gaussian process and logistic regression are employed to learn the unknown thermal dynamics model and customer opt-out behavior model, respectively. We consider two typical DR objectives for AC load control: 1) minimizing the total demand, 2) closely tracking a regulated power trajectory. Based on the Thompson sampling framework, we propose an online DR control algorithm to learn customer behaviors and make real-time AC control schemes. This algorithm considers the influence of various environmental factors on customer behaviors and is implemented in a distributed fashion to preserve the privacy of customers. Numerical simulations demonstrate the control optimality and learning efficiency of the proposed algorithm.Keywords
Funding Information
- National Science Fund CAREER (ECCS-1553407)
- National Science Fund EAGER (ECCS-1839632)
This publication has 27 references indexed in Scilit:
- Investigating willingness to save energy and communication about energy use in the American workplace with the attitude-behavior-context modelEnergy Research & Social Science, 2017
- A Framework of Residential Demand Aggregation With Financial IncentivesIEEE Transactions on Smart Grid, 2016
- Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement LearningIEEE Transactions on Smart Grid, 2016
- On linear convergence of a distributed dual gradient algorithm for linearly constrained separable convex problemsAutomatica, 2015
- Residential Demand Response: Dynamic Energy Management and Time-Varying Electricity PricingIEEE Transactions on Power Systems, 2015
- Optimal Demand Response Using Device-Based Reinforcement LearningIEEE Transactions on Smart Grid, 2015
- Learning to Optimize via Posterior SamplingMathematics of Operations Research, 2014
- Bayesian Inference for Logistic Models Using Pólya–Gamma Latent VariablesJournal of the American Statistical Association, 2013
- Modelling and control of nonlinear systems using Gaussian processes with partial model information2012
- Online Learning and Online Convex OptimizationFoundations and Trends in Machine Learning, 2012