Abstract
Federated learning has become an emerging hot research field in industry because of its ability to perform large-scale distributed learning while preserving data privacy. However, recent studies have shown that in the actual use of federated learning, there are device heterogeneity and data not identically and independently distributed (Non-IID) characteristics between client nodes, which will affect the effect of federated learning. In this work, we propose resilient reinforcement federated learning (R $^{2}$ Fed), a R $^{2}$ Fed method, which applies reinforcement learning to federated learning and uses reinforcement learning for weighted fusion of client models instead of average fusion. We conduct experiments on object detection, object classification, and sentiment classification tasks in the context of Non-IID and heterogeneity, and the experimental results show that the R $^{2}$ Fed method outperforms traditional federated learning, increasing the average accuracy by 4.7%. Experiments also demonstrate that R $^{2}$ Fed is resilient to federation attacks.
Funding Information
  • National Natural Science Foundation of China (62072469)
  • Opening Project of the State Key Laboratory for Management and Control Complex Systems
  • Institute of Automation
  • Chinese Academy of Sciences (20210114)

This publication has 18 references indexed in Scilit: