Privacy-Preserving Asynchronous Grouped Federated Learning for IoT
- 9 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (7) , 5511-5523
Abstract
Federated learning (FL), a cooperative distributed learning framework, has been employed in various intelligent Internet of Things (IoT) applications (e.g., smart health-care, smart home, and smart industry). However, there may be malicious devices in these IoT applications inferring other devices’ privacy or destroying the uploaded model parameters. Besides, due to the heterogeneity of IoT devices, it is difficult for the existing synchronized FL to effectively train models through non-identical independently distributed (non-IID) local data sets. To address these issues, we propose an asynchronous grouped federated learning framework (PAG-FL) for IoT, enabling multiple devices and the server to collaboratively and efficiently train models without revealing privacy. PAG-FL framework consists of an adaptive Rényi Differential Privacy-based privacy budget allocation (ARB) protocol and an asynchronous weight-based grouped update (AWGU) algorithm. In particular, our ARB protocol applies Rényi Differential Privacy and adaptively adjusts the privacy budget to obtain an efficient local model. The AWGU algorithm can defend against the poisoning attack on non-IID data set by weighing grouped local models to generate a global model. Meanwhile, it also realizes the asynchronous optimized update by adopting a lazy loading strategy. Theoretically, the proposed framework has a convergence guarantee and a privacy guarantee when training over the non-IID data set in an asynchronous FL. Our empirical experiments validate the effectiveness of the theoretical design and demonstrate the improved utility and robustness of PAG-FL in heterogeneous IoT.Keywords
Funding Information
- National key research and development program (2018YFE0207600)
- Key Research and Development Program of Shaanxi (2019ZDLGY13-03-01, 2019ZDLGY13-06, 2020CGXNG-002, 2021ZDLGY07-05, 2021KWZ-04)
- Aeronautical Science Foundation of China (20181981006)
- National Natural Science Foundation of China (61972310)
- Fundamental Research Funds for the Central Universities (JB210306)
This publication has 17 references indexed in Scilit:
- Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT NetworksIEEE Internet of Things Journal, 2020
- Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted AggregationIEEE Transactions on Neural Networks and Learning Systems, 2019
- Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial IntelligenceIEEE Transactions on Industrial Informatics, 2019
- Differentially Private Asynchronous Federated Learning for Mobile Edge Computing in Urban InformaticsIEEE Transactions on Industrial Informatics, 2019
- Differentially Private Model Publishing for Deep Learning2019
- Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning2019
- CNTK2016
- RescueDP: Real-time spatio-temporal crowd-sourced data publishing with differential privacy2016
- Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures2015
- Calibrating Noise to Sensitivity in Private Data Analysis2006