Behave Differently when Clustering: A Semi-asynchronous Federated Learning Approach for IoT
Open Access
- 23 February 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Sensor Networks
- Vol. 20 (3) , 1-28
Abstract
The Internet of Things (IoT) has revolutionized the connectivity of diverse sensing devices, generating an enormous volume of data. However, applying machine learning algorithms to sensing devices presents substantial challenges due to resource constraints and privacy concerns. Federated learning (FL) emerges as a promising solution allowing for training models in a distributed manner while preserving data privacy on client devices. We contribute SAFI , a semi-asynchronous FL approach based on clustering to achieve a novel in-cluster synchronous and out-cluster asynchronous FL training mode. Specifically, we propose a three-tier architecture to enable IoT data processing on edge devices and design a clustering selection module to effectively group heterogeneous edge devices based on their processing capacities. The performance of SAFI has been extensively evaluated through experiments conducted on a real-world testbed. As the heterogeneity of edge devices increases, SAFI surpasses the baselines in terms of the convergence time, achieving a speedup of approximately × 3 when the heterogeneity ratio is 7:1. Moreover, SAFI demonstrates favorable performance in non-independent and identically distributed settings and requires lower communication cost compared to FedAsync. Notably, SAFI is the first Java-implemented FL approach and holds significant promise to serve as an efficient FL algorithm in IoT environments.Keywords
Funding Information
- Guangzhou Municipal Nansha District Science and Technology Bureau (2022ZD012)
- Nordic University Cooperation on Edge Intelligence (168043)
This publication has 30 references indexed in Scilit:
- Pervasive AI for IoT Applications: A Survey on Resource-Efficient Distributed Artificial IntelligenceIEEE Communications Surveys & Tutorials, 2022
- Accelerating Federated Learning With Cluster Construction and Hierarchical AggregationIEEE Transactions on Mobile Computing, 2022
- A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of ThingsIEEE Internet of Things Journal, 2021
- A Survey on Federated Learning for Resource-Constrained IoT DevicesIEEE Internet of Things Journal, 2021
- Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open ChallengesIEEE Communications Surveys & Tutorials, 2021
- Federated Learning Meets Blockchain in Edge Computing: Opportunities and ChallengesIEEE Internet of Things Journal, 2021
- A Distributed Hierarchical Deep Computation Model for Federated Learning in Edge ComputingIEEE Transactions on Industrial Informatics, 2021
- Federated Machine Learning: Survey, Multi-Level Classification, Desirable Criteria and Future Directions in Communication and Networking SystemsIEEE Communications Surveys & Tutorials, 2021
- A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and BeyondIEEE Internet of Things Journal, 2020
- Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based FrameworkIEEE Open Journal of the Computer Society, 2020