Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks
- 13 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (21) , 34325-34336
Abstract
Currently, there is a growing trend in deploying ubiquitous artificial intelligence (AI) applications at the network edge. As a promising framework that enables secure edge intelligence, federated learning (FL) has been paid attention, where the over-the-air computing technique has been adopted to enhance the communication efficiency. In this study, we focus on over-the-air FL over a large-scale network with numerous edge devices. Joint device selection and aggregate beamforming design is investigated under two different objectives, i.e., minimizing the aggregate error and maximizing the number of selected devices. Two combinatorial problems are formulated, which are demanding to solve especially in the large-scale network. To reduce the computational complexity, a random aggregate beamforming scheme is proposed, which employs random sampling instead of optimization to determine the aggregator beamforming vector. Notably, the implementation of the proposed scheme does not necessitate the full channel estimation. Asymptotic analysis reveals that the aggregate error asymptotically follows a Gaussian distribution, and the number of selected devices approximates a symmetrical distribution. The distribution parameters are explicitly expressed by the transmit power, the numbers of devices and selected devices. Simulation results confirm the theoretical analysis and demonstrate the effectiveness of the proposed random aggregate beamforming scheme.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62225107, 62271140)
- Fundamental Research Funds for the Central Universities (2242022k60002)
- Natural Science Foundation on Frontier Leading Technology Basic Research Project of Jiangsu (BK20222001)
- Major Key Project of Peng Cheng Laboratory
- National Research Foundation, Singapore
- Infocomm Media Development Authority under its Future Communications Research and Development Programme
- DSO National Laboratories through the AI Singapore Programme (AISG2-RP-2020-019, FCP-ASTAR-TG-2022-003)
- Ministry of Education (MOE) Tier 1 (RG87/22)
This publication has 25 references indexed in Scilit:
- Distributed Over-the-Air Computing for Fast Distributed Optimization: Beamforming Design and Convergence AnalysisIEEE Journal on Selected Areas in Communications, 2022
- Distributed Learning in Wireless Networks: Recent Progress and Future ChallengesIEEE Journal on Selected Areas in Communications, 2021
- Learning Rate Optimization for Federated Learning Exploiting Over-the-Air ComputationIEEE Journal on Selected Areas in Communications, 2021
- Device Scheduling with Fast Convergence for Wireless Federated Learning2020
- Edge Intelligence: The Confluence of Edge Computing and Artificial IntelligenceIEEE Internet of Things Journal, 2020
- Toward an Intelligent Edge: Wireless Communication Meets Machine LearningIEEE Communications Magazine, 2020
- Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract TheoryIEEE Internet of Things Journal, 2019
- Parametric Noise Injection: Trainable Randomness to Improve Deep Neural Network Robustness Against Adversarial Attack2019
- Over-the-Air Computation for IoT Networks: Computing Multiple Functions With Antenna ArraysIEEE Internet of Things Journal, 2018
- Semidefinite Relaxation of Quadratic Optimization ProblemsIEEE Signal Processing Magazine, 2010