Double Q-learning for Demand Response of an Electric Water Heater
- 1 September 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Increasing the share of renewable energy sources in the electrical grid requires new balancing means. Therefore, activating flexibility at the demand side with Demand Response (DR) programs has gained significant attention in recent years. In this regard, Thermostatically Controlled Loads (TCLs) are interesting appliances, due to their inherent storage capacity. In this paper, double Q-learning is applied to an Electric Water Heater (EWH) in two different DR settings. The first assumes the EWH's energy consumption is billed according to a Time-of-Use (ToU) price. The second scenario assumes households have a power consumption limit. In both cases, the control policy learned with double Q-learning is compared to a thermostat controller. With ToU pricing the EWH consumes 35% less energy during peak hours. When the EWH is charged according to a capacity tariff Q-learning reduces power consumption limit surpasses by 31%.Keywords
This publication has 7 references indexed in Scilit:
- Trajectory Tracking With an Aggregation of Domestic Hot Water Heaters: Combining Model-Based and Model-Free Control in a Commercial DeploymentIEEE Transactions on Smart Grid, 2019
- Intelligent Electric Water Heater Control with Varying State Information2018
- Using reinforcement learning for optimizing heat pump control in a building model in Modelica2018
- Battery Energy Management in a Microgrid Using Batch Reinforcement LearningEnergies, 2017
- Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement LearningIEEE Transactions on Smart Grid, 2016
- Cluster Control of Heterogeneous Thermostatically Controlled Loads Using Tracer DevicesIEEE Transactions on Smart Grid, 2015
- A Smart Domestic Hot Water BufferIEEE Transactions on Smart Grid, 2012