Decentralised Learning in Federated Deployment Environments
Authors:
Top Cited Papers
Open Access
- 11 February 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 54 (1) , 1-38
Abstract
Decentralised learning is attracting more and more interest because it embodies the principles of data minimisation and focused data collection, while favouring the transparency of purpose specification (i.e., the objective for which a model is built). Cloud-centric-only processing and deep learning are no longer strict necessities to train high-fidelity models; edge devices can actively participate in the decentralised learning process by exchanging meta-level information in place of raw data, thus paving the way for better privacy guarantees. In addition, these new possibilities can relieve the network backbone from unnecessary data transfer and allow it to meet strict low-latency requirements by leveraging on-device model inference. This survey provides a detailed and up-to-date overview of the most recent contributions available in the state-of-the-art decentralised learning literature. In particular, it originally provides the reader audience with a clear presentation of the peculiarities of federated settings, with a novel taxonomy of decentralised learning approaches, and with a detailed description of the most relevant and specific system-level contributions of the surveyed solutions for privacy, communication efficiency, non-IIDness, device heterogeneity, and poisoning defense.Keywords
This publication has 51 references indexed in Scilit:
- Deep Models Under the GAN2017
- EXEGESIS: Extreme Edge Resource Harvesting for a Virtualized Fog EnvironmentIEEE Communications Magazine, 2017
- A Collaborative Privacy-Preserving Deep Learning System in Distributed Mobile Environment2016
- Deep Learning with Differential Privacy2016
- Inverting Visual Representations with Convolutional Networks2016
- PPDM: A Privacy-Preserving Protocol for Cloud-Assisted e-Healthcare SystemsIEEE Journal of Selected Topics in Signal Processing, 2015
- Measuring and testing dependence by correlation of distancesThe Annals of Statistics, 2007
- How to Generate Cryptographically Strong Sequences of Pseudorandom BitsSIAM Journal on Computing, 1984
- How to share a secretCommunications of the ACM, 1979
- New directions in cryptographyIEEE Transactions on Information Theory, 1976