Client Scheduling and Resource Management for Efficient Training in Heterogeneous IoT-Edge Federated Learning
- 6 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Vol. 41 (8) , 2407-2420
Abstract
Federated learning (FL) offers a promising paradigm that empowers numerous Internet of Things (IoT) devices to implement distributed learning on the premise of ensuring user privacy and data security. However, since FL adopts a synchronous distributed training mode, the heterogeneity of participating IoT devices and limited communication resources make FL encounter serious issues of low training efficiency in actual deployment. In this article, we propose an excellent FL policy for the heterogeneous IoT-edge FL system to improve distributed training efficiency. Specifically, first, by borrowing the idea of clustering, we explore an iterative self-organizing data analysis techniques algorithm (ISODATA)-based heterogeneous-aware client scheduling strategy to alleviate the issue of low training efficiency incurred by the heterogeneity of clients. Subsequently, to tackle the challenge of limited communication resources in FL, we first analyze the characteristics of the optimal resource block allocation solution theoretically and then introduce a mixed-integer linear programming (MILP)-based strategy to judiciously allocate resource blocks for scheduled clients. Comprehensive experimental results demonstrate that, compared with benchmarking strategies, our proposed FL policy can achieve up to 55.22% accuracy improvement in a relaxed time scenario, and attain up to $3.62\times $ acceleration for reaching the specific expected accuracy.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFB2101300)
- NSFC (61871186, 62102164)
- China Postdoctoral Science Foundation (2021T140272, 2021M691240)
- Fundamental Research Funds for the Central Universities (21621025)
This publication has 35 references indexed in Scilit:
- Adaptive Federated Learning in Resource Constrained Edge Computing SystemsIEEE Journal on Selected Areas in Communications, 2019
- Privacy-Preserving Tensor Decomposition Over Encrypted Data in a Federated Cloud EnvironmentIEEE Transactions on Dependable and Secure Computing, 2018
- DeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge ClustersIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Latency Optimization for Resource Allocation in Mobile-Edge Computation OffloadingIEEE Transactions on Wireless Communications, 2018
- INVITED: Bandwidth-Efficient Deep Learning2018
- Energy-Efficient Resource Allocation for Mobile-Edge Computation OffloadingIEEE Transactions on Wireless Communications, 2016
- Deep Residual Learning for Image Recognition2016
- Deep learningNature, 2015
- Fast Model Predictive Control for Urban Road Networks via MILPIEEE Transactions on Intelligent Transportation Systems, 2011
- A Convergence Theorem for the Fuzzy ISODATA Clustering AlgorithmsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1980