Rate-Convergence Tradeoff of Federated Learning Over Wireless Channels
- 11 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (24) , 22703-22716
Abstract
In this paper, we consider a federated learning problem over wireless channel that takes into account the coding rate and packet transmission errors. Communication channels are modeled as packet erasure channels (PEC), where the probability of erasure is determined by block length, code rate, and signal-to-noise ratio (SNR). In spite of fluctuations in instantaneous loss of federated learning (FL), we prove that the expectation of loss converges even in the presence of packet erasure. To mitigate the impact of packet erasure on FL performance, we suggest a paradigm in which the central node (CN) makes use of memory. In particular, we propose two schemes in which, in the event of packet erasure, the CN retains either the most recent local updates or the most recent global parameters. We investigate the impact of coding rate, SNR, and the CN memory on the convergence of FL. For both short-and long-packet communications, we examine a realistic scenario of a massive IoT under the assumption of error-prone transmissions. Our simulation results demonstrate that even a single memory unit has a considerable effect on the FL’s efficiency in erroneous communication.Keywords
All Related Versions
Funding Information
- Australian Research Council (DP180100606, DP220102736)
This publication has 34 references indexed in Scilit:
- Developing IoT Devices Empowered by Artificial Intelligence: Experimental Study2019
- Adaptive Federated Learning in Resource Constrained Edge Computing SystemsIEEE Journal on Selected Areas in Communications, 2019
- Classification of Indoor Environments for IoT Applications: A Machine Learning ApproachIEEE Antennas and Wireless Propagation Letters, 2018
- Optimization Methods for Large-Scale Machine LearningSIAM Review, 2018
- Squeezing Deep Learning into Mobile and Embedded DevicesIEEE Pervasive Computing, 2017
- Hybrid Deterministic-Stochastic Methods for Data FittingSIAM Journal on Scientific Computing, 2012
- Channel Coding Rate in the Finite Blocklength RegimeIEEE Transactions on Information Theory, 2010
- Saddlepoint Approximations with Applications2007
- Survival Models and Data Analysis1999
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998