FLAD: Byzantine-Robust Federated Learning Based on Gradient Feature Anomaly Detection
- 17 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Dependable and Secure Computing
- Vol. 22 (4) , 3993-4009
Abstract
Federated Learning (FL) has gained significant attention due to its ability to jointly train global models by exchanging local gradients instead of raw local datasets. However, poisoning attacks have emerged as a severe threat to FL security, where malicious clients submit crafted gradients to compromise the integrity and availability of the model. Although researchers have worked on countering these attacks to achieve Byzantine-robust FL, it remains challenging to balance high accuracy, robustness, and efficiency simultaneously. We propose FLAD, a novel Byzantine-robust FL approach based on gradient feature anomaly detection, which is the first approach that uses neural networks to adaptively learn gradient features and measure feature similarity to counteract various types of poisoning attacks. Specifically, FLAD employs a small clean dataset to bootstrap trust and trains Feature Extraction Models (FEM). With FEM and DBSCAN clustering, abnormal gradients from malicious clients are detected and eliminated. Extensive experiments on both Non-IID and IID datasets demonstrate that FLAD achieves superior accuracy, robustness, efficiency, and generalizability compared to state-of-the-art approaches. Additionally, we implement privacy-preserving FLAD (PFLAD) using CKKS and Random Permutation techniques to ensure transmitted gradient privacy.Keywords
Funding Information
- Science and Technology Innovation Plan Of Shanghai Science (24BC3200600)
This publication has 28 references indexed in Scilit:
- MPAF: Model Poisoning Attacks to Federated Learning based on Fake Clients2022
- Mitigating Poisoning Attacks in Federated Learning2022
- Byzantine-Resilient Secure Federated LearningIEEE Journal on Selected Areas in Communications, 2020
- Deep Leakage from Gradients2020
- PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakageInformation Sciences, 2020
- Data Poisoning Attacks Against Federated Learning Systems2020
- Byzantine-resilient Distributed Large-scale Matrix Completion2019
- Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learning2018
- Homomorphic Encryption for Arithmetic of Approximate Numbers2017
- The security of machine learningMachine Learning, 2010