Heterogeneous Semi-Asynchronous Federated Learning in Internet of Things: A Multi-Armed Bandit Approach
- 14 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 6 (5) , 1113-1124
Abstract
Federated learning (FL) has recently received significant attention in Internet of Things, due to its capability of enabling multiple clients to collaboratively train machine learning models using neural networks, without sharing their privacy-sensitive data. However, due to the heterogeneity of clients in their computation and communication capability, they might not return the training model to the server at the same time, which may result in high waiting latency at the server, especially in synchronous FL. Although asynchronous FL can reduce the waiting latency, aggregating global model in a completely asynchronous way may lead to some local models out of date, resulting in low training accuracy. To address the above issues, this paper aims to propose a novel Heterogeneous Semi-Asynchronous FL mechanism, named HSA_FL . Firstly, we use a Multi-Armed Bandit (MAB) approach to identify the heterogenous communication and computation capabilities of clients, based on which, we assign different training intensities to clients. Generally, the clients with lower capabilities will be assigned with less number of local updates. In addition, instead of waiting all the clients to return their training models or immediately aggregation after getting a single local model, this paper proposes two aggregation rules, named adaptive update and fixed adaptive, respectively. Finally, simulation results show that the proposed scheme can effectively reduce the training time and improve the training accuracy as compared with some benchmark algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (61872150, 61972448)
- Basic and Applied Basic Research Foundation of Guangdong Province (2020A1515011209)
- Science and Technology Program of Guangzhou (202002030426, 2019A1515011792)
- Guangzhou Municipal Science and Technology Program key projects (202007040002, 2019B010154004)
- Guangdong Major Project of Basic and Applied Basic Research (2019B030302002)
- Guangzhou Development Zone Science and Technology (2020GH10)
This publication has 28 references indexed in Scilit:
- Machine learning for internet of things data analysis: a surveyDigital Communications and Networks, 2018
- Internet of Vehicles: Sensing-Aided Transportation Information Collection and DiffusionIEEE Transactions on Vehicular Technology, 2018
- Exploiting Massive D2D Collaboration for Energy-Efficient Mobile Edge ComputingIEEE Wireless Communications, 2017
- Mobile Edge Computing: A Survey on Architecture and Computation OffloadingIEEE Communications Surveys & Tutorials, 2017
- Asynchronous Multi-task Learning2016
- A Review on Big Data Analysis and Internet of Things2016
- Big data caching for networking: moving from cloud to edgeIEEE Communications Magazine, 2016
- Fog and IoT: An Overview of Research OpportunitiesIEEE Internet of Things Journal, 2016
- Distributed Analytics and Edge Intelligence2015
- Vehicular communication systems: Enabling technologies, applications, and future outlook on intelligent transportationIEEE Communications Magazine, 2009