ERIS: Enhancing Privacy and Communication Efficiency in Serverless Federated Learning
Authors:
- Dario FenoglioDFDario Fenoglio
- Pasquale PolverinoPPPasquale Polverino
- Jacopo QuiziJQJacopo Quizi
- Martin GjoreskiMGMartin Gjoreski
- Marc LangheinrichMLMarc Langheinrich
Preprint
Abstract
Scaling federated learning (FL) to billion-parameter models introduces critical trade-offs between communication efficiency, model accuracy, and privacy guarantees. Existing solutions often tackle these challenges in isolation, sacrificing accuracy or relying on costly cryptographic tools. We propose ERIS, a serverless FL framework that balances privacy and accuracy while eliminating the server bottleneck and distributing the communication load. ERIS combines a model partitioning strategy, distributing aggregation across multiple client-side aggregators, with a distributed shifted gradient compression mechanism. We theoretically prove that ERIS (i) converges at the same rate as FedAvg under standard assumptions, and (ii) bounds mutual information leakage inversely with the number of aggregators, enabling strong privacy guarantees with no accuracy degradation. Experiments across image and text tasks, including large language models, confirm that ERIS achieves FedAvg-level accuracy while substantially reducing communication cost and improving robustness to membership inference and reconstruction attacks, without relying on heavy cryptography or noise injection.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Enhance membership inference attacks in federated learningComputers & Security, 2023
- Securing Federated Learning Enabled NWDAF Architecture With Partial Homomorphic EncryptionIEEE Networking Letters, 2023
- Decentralized federated learning through proxy model sharingNature Communications, 2023
- A Convergence Theory for Federated Average: Beyond Smoothness2022
- Preserving data privacy in federated learning through large gradient pruningComputers & Security, 2022
- Source Inference Attacks in Federated Learning2021
- Communication Reducing Quantization for Federated Learning with Local Differential Privacy Mechanism2021
- Deep Residual Learning for Image Recognition2016
- Matplotlib: A 2D Graphics EnvironmentComputing in Science & Engineering, 2007
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998