Federated Client Selection and Attention-Based Aggregation Algorithm on Non-IID Data
Author:
- 11 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 111-114
Abstract
Federated learning is a decentralized machine learning approach that enables multiple devices to collaboratively train a global model while keeping their data localized, thus preserving user privacy. However, the presence of non-independent and identically distributed (Non-IID) data across clients presents significant challenges, including performance degradation and difficulties in model optimization. This paper proposes a novel Federated Client Selection and Attention Aggregation (FCSA) algorithm, designed to address these issues. FCSA improves client selection by considering factors such as training time, data diversity, and historical performance, thereby prioritizing clients that can contribute the most to the global model. On the server side, an attention-based aggregation mechanism is introduced to assign different weights to client updates based on their contributions, optimizing the model aggregation process. Experimental evaluations conducted on the MNIST dataset under Non-IID conditions demonstrate that FCSA outperforms traditional methods like FedAvg, improving model accuracy by approximately 17.5%. Future work will focus on dynamically adjusting weighting strategies to further enhance efficiency across various training stages.Keywords
This publication has 5 references indexed in Scilit:
- Attention Is All You NeedarXiv, 2023
- FLTrust: Byzantine-robust Federated Learning via Trust Bootstrapping2021
- Optimizing Federated Learning on Non-IID Data with Reinforcement Learning2020
- Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge2019
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998