Privacy-Enhanced Decentralized Federated Learning at Dynamic Edge
- 25 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 72 (8) , 2165-2180
Abstract
Decentralized Federated Learning (DeFL) plays a critical role in improving effectiveness of training and has been proved to give great scope to the development of edge computing. However, on the one hand, inaccessibility of private data and excessively exploiting the data throughout the learning process have become a public concern, and on the other hand the connections between server-less edge devices are always varying due to the mobility of edge intelligent devices. To address the above issues, we propose a P rivacy- E nhanced - D ynamic - D ecentralized - F ederated - L earning algorithm called PED $ ^{2}$ FL in a dynamic edge environment. We design the PED $ ^{2}$ FL under the analog transmission scheme, where mobile edge devices transmit privacy preserving data simultaneously and accomplish efficient information aggregation with doubly-stochastic adjacent matrices. With thorough analysis, it can be demonstrated that PED $ ^{2}$ FL satisfies $(\epsilon,\delta)$ -differential privacy while the per-device privacy budget decays exponentially with the number of the neighbors, which greatly improved the data utility compared to the fixed budget in the orthogonal transmission strategy. PED $ ^{2}$ FL has the same convergence rate $\mathcal {O}(\sqrt{\frac{1}{KN}})$ as the non-private decentralized learning algorithm D-PSGD without enhanced privacy protection, where $K$ and $N$ are the total iterations and the number of nodes, respectively. Extensive experiments show that algorithm PED $ ^{2}$ FL also performs well with real-world settings.
Keywords
Funding Information
- National Natural Science Foundation of China (61971269)
This publication has 30 references indexed in Scilit:
- Federated Learning With Differential Privacy: Algorithms and Performance AnalysisIEEE Transactions on Information Forensics and Security, 2020
- Federated Learning Over Wireless Fading ChannelsIEEE Transactions on Wireless Communications, 2020
- Fast and Efficient Convolutional Accelerator for Edge ComputingIEEE Transactions on Computers, 2020
- Differentially Private Asynchronous Federated Learning for Mobile Edge Computing in Urban InformaticsIEEE Transactions on Industrial Informatics, 2019
- Exploiting Unintended Feature Leakage in Collaborative Learning2019
- LOGAN: Membership Inference Attacks Against Generative ModelsProceedings on Privacy Enhancing Technologies, 2018
- Consensus-based Distributed Optimization in Multi-agent Systems: Convergence and Differential Privacy2018
- Differentially Private Gossip Gradient Descent2018
- Membership Inference Attacks Against Machine Learning Models2017
- The Algorithmic Foundations of Differential PrivacyFoundations and Trends® in Theoretical Computer Science, 2014