Privacy and Efficiency of Communications in Federated Split Learning
- 29 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 9 (5) , 1380-1391
Abstract
Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors.Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make valuable predictions. Distributed machine learning techniques such as Federated and Split Learning have recently been developed to protect user data and privacy better while ensuring high performance. Both of these distributed learning architectures have advantages and disadvantages. In this paper, we examine these tradeoffs and suggest a new hybrid Federated Split Learning architecture that combines the efficiency and privacy benefits of both. Our evaluation demonstrates how our hybrid Federated Split Learning approach can lower the amount of processing power required by each client running a distributed learning system, reduce training and inference time while keeping a similar accuracy. We also discuss the resiliency of our approach to deep learning privacy inference attacks and compare our solution to other recently proposed benchmarks.Keywords
All Related Versions
Funding Information
- National Science Foundation (CNS-1908574, CNS-1908677)
This publication has 28 references indexed in Scilit:
- Learning from Differentially Private Neural Activations with Edge Computing2018
- Distributed learning of deep neural network over multiple agentsJournal of Network and Computer Applications, 2018
- Model Inversion Attacks for Prediction Systems: Without Knowledge of Non-Sensitive Attributes2017
- End-to-end encrypted traffic classification with one-dimensional convolution neural networks2017
- EMNIST: Extending MNIST to handwritten letters2017
- Neurosurgeon2017
- Deep Learning with Differential Privacy2016
- Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures2015
- ImageNet: A large-scale hierarchical image database2009
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998