DeFL: Defending against Model Poisoning Attacks in Federated Learning via Critical Learning Periods Awareness
Open Access
- 26 June 2023
- journal article
- research article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 37 (9) , 10711-10719
Abstract
Federated learning (FL) is known to be susceptible to model poisoning attacks in which malicious clients hamper the accuracy of the global model by sending manipulated model updates to the central server during the FL training process. Existing defenses mainly focus on Byzantine-robust FL aggregations, and largely ignore the impact of the underlying deep neural network (DNN) that is used to FL training. Inspired by recent findings on critical learning periods (CLP) in DNNs, where small gradient errors have irrecoverable impact on the final model accuracy, we propose a new defense, called a CLP-aware defense against poisoning of FL (DeFL). The key idea of DeFL is to measure fine-grained differences between DNN model updates via an easy-to-compute federated gradient norm vector (FGNV) metric. Using FGNV, DeFL simultaneously detects malicious clients and identifies CLP, which in turn is leveraged to guide the adaptive removal of detected malicious clients from aggregation. As a result, DeFL not only mitigates model poisoning attacks on the global model but also is robust to detection errors. Our extensive experiments on three benchmark datasets demonstrate that DeFL produces significant performance gain over conventional defenses against state-of-the-art model poisoning attacks.Keywords
This publication has 4 references indexed in Scilit:
- DeFL: Defending against Model Poisoning Attacks in Federated Learning via Critical Learning Periods AwarenessProceedings of the AAAI Conference on Artificial Intelligence, 2023
- MPAF: Model Poisoning Attacks to Federated Learning based on Fake Clients2022
- Unsupervised Scalable Statistical Method for Identifying Influential Users in Online Social NetworksScientific Reports, 2018
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998