Over-the-Air Computation Assisted Federated Learning with Progressive Training
Authors:
- 9 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5664-5669
Abstract
Federated learning (FL) with progressive training is a promising privacy-preserving and communication-efficient framework for edge intelligence applications. Specifically, by partitioning the global model into multiple sub-models and dividing the FL training into multiple stages, FL with progressive training enables the gradual training of a large model, thereby significantly reducing the transmission overhead without compromising learning performance. However, implementing FL with progressive training over wireless networks is hindered by the limited radio and energy resources. To address these issues, we adopt over-the-air computation (AirComp) to support FL with progressive training over wireless networks. By balancing the tradeoff between the AirComp transmission distortion and the transition efficiency of progressive training, we formulate a mixed-integer optimization problem with energy and power constraints, which is further decomposed into several subproblems via Lyapunov optimization. Subsequently, we develop a low computational-complexity algorithm that jointly optimizes transmit power, receive beamforming, and transition indicator in an alternating manner. Simulation results demonstrate the effectiveness of our optimization algorithm in improving the learning performance of the considered FL system.Keywords
This publication has 15 references indexed in Scilit:
- Toward Scalable Wireless Federated Learning: Challenges and SolutionsIEEE Internet of Things Magazine, 2023
- Task-Oriented Communications for 6G: Vision, Principles, and TechnologiesIEEE Wireless Communications, 2023
- Communication-Efficient Distributed Learning: An OverviewIEEE Journal on Selected Areas in Communications, 2023
- Efficient Federated Learning for AIoT Applications Using Knowledge DistillationIEEE Internet of Things Journal, 2022
- Interference Management for Over-the-Air Federated Learning in Multi-Cell Wireless NetworksIEEE Journal on Selected Areas in Communications, 2022
- Optimized Power Control Design for Over-the-Air Federated Edge LearningIEEE Journal on Selected Areas in Communications, 2021
- Dynamic Scheduling for Over-the-Air Federated Edge Learning With Energy ConstraintsIEEE Journal on Selected Areas in Communications, 2021
- Joint Model Pruning and Device Selection for Communication-Efficient Federated Edge LearningIEEE Transactions on Communications, 2021
- Adaptive Network Pruning for Wireless Federated LearningIEEE Wireless Communications Letters, 2021
- Stochastic Network Optimization with Application to Communication and Queueing Systems2010