Federated Learning with Gaussian Differential Privacy
Authors:
Open Access
- 17 October 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 296-301
Abstract
In recent years, federated learning has rapidly become a new research hotspot in the field of secure machine learning. However, unprotected traditional federated learning can easily leak information, which unable to meet users' anonymization needs. Differential privacy is widely used in privacy protection due to its excellent privacy quantification properties, but differential privacy as a lossy protection will reduce the accuracy of the machine learning model. This paper proposes a federated learning algorithm based on Gaussian differential privacy, Noisy-FL, which can more accurately track the changes in privacy loss during model training. Noisy-FL can achieve user-level privacy protection while increasing the number of communication rounds compared to the previous algorithm. Experimental results show that the new algorithm can increase the number of communication rounds by 3 times, and when the total number of clients is small, the model accuracy of the Noisy-FL algorithm is increased by 10% compared to the previous algorithm.Keywords
This publication has 7 references indexed in Scilit:
- Analyzing User-Level Privacy Attack Against Federated LearningIEEE Journal on Selected Areas in Communications, 2020
- BACombo—Bandwidth-Aware Decentralized Federated LearningElectronics, 2020
- Practical Secure Aggregation for Privacy-Preserving Machine Learning2017
- Deep Learning with Differential Privacy2016
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014
- A firm foundation for private data analysisCommunications of the ACM, 2011
- Boosting and Differential Privacy2010