R$^{2}$Fed: Resilient Reinforcement Federated Learning for Industrial Applications
- 15 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 19 (8) , 8829-8840
Abstract
Federated learning has become an emerging hot research field in industry because of its ability to perform large-scale distributed learning while preserving data privacy. However, recent studies have shown that in the actual use of federated learning, there are device heterogeneity and data not identically and independently distributed (Non-IID) characteristics between client nodes, which will affect the effect of federated learning. In this work, we propose resilient reinforcement federated learning (R $^{2}$ Fed), a R $^{2}$ Fed method, which applies reinforcement learning to federated learning and uses reinforcement learning for weighted fusion of client models instead of average fusion. We conduct experiments on object detection, object classification, and sentiment classification tasks in the context of Non-IID and heterogeneity, and the experimental results show that the R $^{2}$ Fed method outperforms traditional federated learning, increasing the average accuracy by 4.7%. Experiments also demonstrate that R $^{2}$ Fed is resilient to federation attacks.Keywords
Funding Information
- National Natural Science Foundation of China (62072469)
- Opening Project of the State Key Laboratory for Management and Control Complex Systems
- Institute of Automation
- Chinese Academy of Sciences (20210114)
This publication has 18 references indexed in Scilit:
- Parallel-data-based social evolution modelingTsinghua Science and Technology, 2021
- Decentralised Learning in Federated Deployment EnvironmentsACM Computing Surveys, 2021
- Dynamic-Fusion-Based Federated Learning for COVID-19 DetectionIEEE Internet of Things Journal, 2021
- Federated Visual Classification with Real-World Data Distribution2020
- Federated Reinforcement Learning for Energy Management of Multiple Smart Homes With Distributed Energy ResourcesIEEE Transactions on Industrial Informatics, 2020
- AFRL: Adaptive federated reinforcement learning for intelligent jamming defense in FANETJournal of Communications and Networks, 2020
- Optimizing Federated Learning on Non-IID Data with Reinforcement Learning2020
- Experience-Driven Computational Resource Allocation of Federated Learning by Deep Reinforcement Learning2020
- Multiagent DDPG-Based Deep Learning for Smart Ocean Federated Learning IoT NetworksIEEE Internet of Things Journal, 2020
- A Stochastic Approximation Method1985