Fedlabx: a practical and privacy-preserving framework for federated learning
Open Access
- 31 July 2023
- journal article
- research article
- Published by Springer Nature in Complex & Intelligent Systems
- Vol. 10 (1) , 677-690
Abstract
Federated learning (FL) draws attention in academia and industry due to its privacy-preserving capability in training machine learning models. However, there are still some critical security attacks and vulnerabilities, including gradients leakage and interference attacks. Meanwhile, communication is another bottleneck in basic FL schemes since large-scale FL parameter transmission leads to inefficient communication, latency, and slower learning processes. To overcome these shortcomings, different communication efficiency strategies and privacy-preserving cryptographic techniques have been proposed. However, a single method can only partially resist privacy attacks. This paper presents a practical, privacy-preserving scheme combining cryptographic techniques and communication networking solutions. We implement Kafka for message distribution, the Diffie–Hellman scheme for secure server aggregation, and gradient differential privacy for interference attack prevention. The proposed approach maintains training efficiency while being able to addressing gradients leakage problems and interference attacks. Meanwhile, the implementation of Kafka and Zookeeper provides asynchronous communication and anonymous authenticated computation with role-based access controls. Finally, we prove the privacy-preserving properties of the proposed solution via security analysis and empirically demonstrate its efficiency and practicality.Keywords
Funding Information
- EIT Digital (2021-1.2.1-EIT-KIC)
- Alexander von Humboldt-Stiftung
This publication has 30 references indexed in Scilit:
- Membership Inference Attacks Against Machine Learning Models2017
- Deep Learning with Differential Privacy2016
- A Comprehensive Comparison of Multiparty Secure Additions with Differential PrivacyIEEE Transactions on Dependable and Secure Computing, 2015
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014
- Differential Privacy: A Survey of Results2008
- Calibrating Noise to Sensitivity in Private Data Analysis2006
- HIPAA Regulations — A New Era of Medical-Record Privacy?New England Journal of Medicine, 2003
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- How to share a secretCommunications of the ACM, 1979
- New directions in cryptographyIEEE Transactions on Information Theory, 1976