Federated Reinforcement Learning for Energy Management of Multiple Smart Homes With Distributed Energy Resources
Authors:
Top Cited Papers
- 3 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 18 (1) , 488-497
Abstract
This article proposesa novel federated reinforcement learning (FRL) approach for the energy management of multiple smart homes with home appliances, a solar photovoltaic system, and an energy storage system. The novelty of the proposed FRL approach lies in the development of a distributed deep reinforcement learning (DRL) model that consists of local home energy management systems (LHEMSs) and a global server (GS). Using energy consumption data, DRL agents for LHEMSs construct and upload their local models to the GS. Then, the GS aggregates the local models to update a global model for LHEMSs and broadcasts it to the DRL agents. Finally, the DRL agents replace the previous local models with the global model and iteratively reconstruct their local models. Simulation results obtained under heterogeneous home environments indicate the advantage of the proposed approach in terms of convergence speed, appliance energy consumption, and number of agents.Keywords
Funding Information
- Basic Science Research Program
- National Research Foundation of Korea
- Ministry of Education (2020R1F1A1049314)
- Ministry of Science and ICT, (MSIT), Korea
- Information Technology Research Center
- Institute for Information & Communications Technology Planning & Evaluation (IITP-2020-2018-0-01799)
This publication has 23 references indexed in Scilit:
- Optimal Home Energy Management System With Demand Charge Tariff and Appliance Operational DependenciesIEEE Transactions on Smart Grid, 2019
- Demand Response for Home Energy Management Using Reinforcement Learning and Artificial Neural NetworkIEEE Transactions on Smart Grid, 2019
- Residential Energy Storage Management With Bidirectional Energy ControlIEEE Transactions on Smart Grid, 2018
- Distributed Optimization Framework for Energy Management of Multiple Smart Homes With Distributed Energy ResourcesIEEE Access, 2017
- Big data issues in smart grid systems2016
- Coordinated Operation of a Neighborhood of Smart Households Comprising Electric Vehicles, Energy Storage and Distributed GenerationIEEE Transactions on Smart Grid, 2016
- Privacy-Preserving Deep Learning2015
- A Near-Optimal Model-Based Control Algorithm for Households Equipped With Residential Photovoltaic Power Generation and Energy Storage SystemsIEEE Transactions on Sustainable Energy, 2015
- Deep learningNature, 2015
- Energy Management for Households With Solar Assisted Thermal Load Considering Renewable Energy and Price UncertaintyIEEE Transactions on Smart Grid, 2014