Eluding Secure Aggregation in Federated Learning via Model Inconsistency
Authors:
Top Cited Papers
Open Access
- 7 November 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2429-2443
Abstract
Secure aggregation is a cryptographic protocol that securely computes the aggregation of its inputs. It is pivotal in keeping model updates private in federated learning. Indeed, the use of secure aggregation prevents the server from learning the value and the source of the individual model updates provided by the users, hampering inference and data attribution attacks. In this work, we show that a malicious server can easily elude secure aggregation as if the latter were not in place. We devise two different attacks capable of inferring information on individual private training datasets, independently of the number of users participating in the secure aggregation. This makes them concrete threats in large-scale, real-world federated learning applications. The attacks are generic and equally effective regardless of the secure aggregation protocol used They exploit a vulnerability of the federated learning protocol caused by incorrect usage of secure aggregation and lack of parameter validation. Our work demonstrates that current implementations of federated learning with secure aggregation offer only a ''false sense of security.''Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Secure Single-Server Aggregation with (Poly)Logarithmic Overhead2020
- VerifyNet: Secure and Verifiable Federated LearningIEEE Transactions on Information Forensics and Security, 2019
- Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning2019
- Exploiting Unintended Feature Leakage in Collaborative Learning2019
- Practical Secure Aggregation for Privacy-Preserving Machine Learning2017
- Deep Models Under the GAN2017
- Membership Inference Attacks Against Machine Learning Models2017
- Deep Learning with Differential Privacy2016
- Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures2015
- Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiersInternational Journal of Security and Networks, 2015