Federated Computing -- Survey on Building Blocks, Extensions and Systems
Preprint
Abstract
In response to the increasing volume and sensitivity of data, traditional centralized computing models face challenges, such as data security breaches and regulatory hurdles. Federated Computing (FC) addresses these concerns by enabling collaborative processing without compromising individual data privacy. This is achieved through a decentralized network of devices, each retaining control over its data, while participating in collective computations. The motivation behind FC extends beyond technical considerations to encompass societal implications. As the need for responsible AI and ethical data practices intensifies, FC aligns with the principles of user empowerment and data sovereignty. FC comprises of Federated Learning (FL) and Federated Analytics (FA). FC systems became more complex over time and they currently lack a clear definition and taxonomy describing its moving pieces. Current surveys capture domain-specific FL use cases, describe individual components in an FC pipeline individually or decoupled from each other, or provide a quantitative overview of the number of published papers. This work surveys more than 150 papers to distill the underlying structure of FC systems with their basic building blocks, extensions, architecture, environment, and motivation. We capture FL and FA systems individually and point out unique difference between those two.Keywords
All Related Versions
This publication has 117 references indexed in Scilit:
- Federated Learning Systems for Healthcare: Perspective and Recent Progress2021
- Towards Blockchain-Based Fair and Trustworthy Federated Learning Systems2021
- An Overview of Federated Deep Learning Privacy Attacks and Defensive Strategies2021
- Differentially Private Federated Learning: Algorithm, Analysis and Optimization2021
- Advancements of Federated Learning Towards Privacy Preservation: From Federated Learning to Split Learning2021
- Federated Learning Research: Trends and Bibliometric Analysis2021
- A Review of Privacy-Preserving Federated Learning for the Internet-of-Things2021
- FedMAX: Mitigating Activation Divergence for Accurate and Communication-Efficient Federated Learning2021
- On Purpose and by Necessity: Compliance Under the GDPR2018
- Universal Artificial Intelligence2018