Joint Beamforming and Learning Rate Optimization for Over-the-Air Federated Learning
- 16 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 72 (10) , 13706-13711
Abstract
In this paper, we consider a joint design of beamforming vector and learning rate in MIMO over-the-air computation (AirComp) for federated learning. Since the learning performance improves with adaptive learning rates, we jointly optimize the receive beamforming vector and the learning rates. We first demonstrate the AirComp-multicasting duality between the uplink AirComp receive beamforming for federated learning systems and the downlink transmit beamforming for multicast systems. We design a low-complexity algorithm based on the projected subgradient method of the dual problem. Numerical results show that the proposed algorithm achieves nearly the same performance as the ideal federated learning system without aggregation errors.Keywords
Funding Information
- Inha University Research Grant
This publication has 11 references indexed in Scilit:
- Interference Management for Over-the-Air Federated Learning in Multi-Cell Wireless NetworksIEEE Journal on Selected Areas in Communications, 2022
- Learning Rate Optimization for Federated Learning Exploiting Over-the-Air ComputationIEEE Journal on Selected Areas in Communications, 2021
- Federated Learning via Intelligent Reflecting SurfaceIEEE Transactions on Wireless Communications, 2021
- Optimized Power Control for Over-the-Air Computation in Fading ChannelsIEEE Transactions on Wireless Communications, 2020
- Federated Learning via Over-the-Air ComputationIEEE Transactions on Wireless Communications, 2020
- MIMO Over-the-Air Computation for High-Mobility Multimodal SensingIEEE Internet of Things Journal, 2018
- A Uniform-Forcing Transceiver Design for Over-the-Air Function ComputationIEEE Wireless Communications Letters, 2018
- Computation Over Multiple-Access ChannelsIEEE Transactions on Information Theory, 2007
- Transmit beamforming for physical-layer multicastingIEEE Transactions on Signal Processing, 2006
- On the Duality of Gaussian Multiple-Access and Broadcast ChannelsIEEE Transactions on Information Theory, 2004