SAFELearn: Secure Aggregation for private FEderated Learning
Authors:
Top Cited Papers
- 1 May 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 56-62
Abstract
Federated learning (FL) is an emerging distributed machine learning paradigm which addresses critical data privacy issues in machine learning by enabling clients, using an aggregation server (aggregator), to jointly train a global model without revealing their training data. Thereby, it improves not only privacy but is also efficient as it uses the computation power and data of potentially millions of clients for training in parallel. However, FL is vulnerable to so-called inference attacks by malicious aggregators which can infer information about clients’ data from their model updates. Secure aggregation restricts the central aggregator to only learn the summation or average of the updates of clients. Unfortunately, existing protocols for secure aggregation for FL suffer from high communication, computation, and many communication rounds.In this work, we present SAFELearn, a generic design for efficient private FL systems that protects against inference attacks that have to analyze individual clients’ model updates using secure aggregation. It is flexibly adaptable to the efficiency and security requirements of various FL applications and can be instantiated with MPC or FHE. In contrast to previous works, we only need 2 rounds of communication in each training iteration, do not use any expensive cryptographic primitives on clients, tolerate dropouts, and do not rely on a trusted third party. We implement and benchmark an instantiation of our generic design with secure two-party computation. Our implementation aggregates 500 models with more than 300K parameters in less than 0.5 seconds.Keywords
Funding Information
- European Research Council
This publication has 21 references indexed in Scilit:
- Federated Learning for Ultra-Reliable Low-Latency V2V Communications2018
- Federated learning of predictive models from federated Electronic Health RecordsInternational Journal of Medical Informatics, 2018
- Practical Secure Aggregation for Privacy-Preserving Machine Learning2017
- Secure Two-Party Computation Using an Efficient Garbled Circuit by Reducing Data Transfer2017
- Membership Inference Attacks Against Machine Learning Models2017
- ABY - A Framework for Efficient Mixed-Protocol Secure Two-Party Computation2015
- Public-Key Cryptosystems Based on Composite Degree Residuosity Classes1999
- How to play ANY mental game1987
- How to generate and exchange secrets1986
- How to share a secretCommunications of the ACM, 1979