Over-the-Air Federated Edge Learning With Hierarchical Clustering
- 17 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (12) , 17856-17871
Abstract
We examine federated learning (FL) with over-the-air (OTA) aggregation, where mobile users (MUs) aim to reach a consensus on a global model with the help of a parameter server (PS) that aggregates the local gradients. In OTA FL, MUs train their models using local data at every training round and transmit their gradients simultaneously using the same frequency band in an uncoded fashion. Based on the received signal of the superposed gradients, the PS performs a global model update. While the OTA FL has a significantly decreased communication cost, it is susceptible to adverse channel effects and noise. Employing multiple antennas at the receiver side can reduce these effects, yet the path-loss is still a limiting factor for users located far away from the PS. To ameliorate this issue, in this paper, we propose a wireless-based hierarchical FL scheme that uses intermediate servers (ISs) to form clusters in the areas where the MUs are more densely located. Our scheme utilizes OTA cluster aggregations for the communication of the MUs with their corresponding IS, and OTA global aggregations from the ISs to the PS. We present a convergence analysis for the proposed algorithm, and show through numerical evaluations of the derived analytical expressions and experimental results that utilizing ISs results in a faster convergence and a better performance than the OTA FL alone while using less transmit power. We also validate the results on the performance using different numbers of cluster iterations with different datasets and data distributions. We conclude that the best choice of cluster aggregations depends on the data distribution among the MUs and the clusters.Keywords
All Related Versions
Funding Information
- CHIST-ERA (CHIST-ERA-20-SICT-004)
- Engineering and Physical Sciences Research Council (EP/W035960/1)
- Engineering and Physical Sciences Research Council (101103430)
- T?rkiye Bilimsel ve Teknolojik Ara?t?rma Kurumu (221N366)
This publication has 31 references indexed in Scilit:
- Hierarchical Over-the-Air Federated Edge Learning2022
- Byzantine-Resilient SGD in High Dimensions on Heterogeneous Data2021
- Communication-efficient federated learningProceedings of the National Academy of Sciences of the United States of America, 2021
- Client Selection for Federated Learning With Non-IID Data in Mobile Edge ComputingIEEE Access, 2021
- Byzantine-Resilient Secure Federated LearningIEEE Journal on Selected Areas in Communications, 2020
- Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power ControlIEEE Journal on Selected Areas in Communications, 2020
- Federated learning with hierarchical clustering of local updates to improve training on non-IID data2020
- Client-Edge-Cloud Hierarchical Federated Learning2020
- Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020