Computation and Communication Resource Optimization for Efficient Hierarchical Federated Learning
- 6 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Networking
- Vol. 34, 502-517
Abstract
Federated Learning (FL) is a sophisticated decentralized approach in machine learning, where individual user devices perform model training locally and then transmit their parameters to a central server. This paper delves into the dynamics of a hierarchical FL system, particularly focusing on the intricate exchange of model parameters between cloud and edge servers, and between edge servers and user devices. The capacity of this hierarchical FL model to achieve predefined global model accuracy is significantly influenced by delays in communication and computation of model parameters. To address these challenges and balance the trade-off between energy consumption and execution time, we formulate a comprehensive joint computation and communication resource optimization problem. This problem is aimed at minimizing the weighted sum of FL completion time and total energy consumption, enhancing overall system efficiency. The problem is methodically decomposed into four sub-problems. The initial three sub-problems utilize fractional programming techniques to find efficient solutions that optimize resource allocation. For the final sub-problem, we employ the Concave-Convex Procedure (CCCP), which is well-suited for dealing with the non-linear aspects of the optimization challenge. We then discuss the computational complexity and give the convergence analysis of the proposed approach. Simulation results underline the effectiveness of our approach, showing faster convergence of the global model under optimized communication and computation conditions. These results clearly demonstrate the beneficial trade-off between FL completion time and energy consumption, indicating that our optimization strategy successfully enhances the performance in hierarchical federated learning systems.Keywords
Funding Information
- National Research Foundation, Singapore, and Infocomm Media Development Authority under its Trust Tech Funding Initiative
- National Research Foundation, Singapore, under its Strategic Capability Research Centres Funding Initiative
- Singapore Ministry of Education Academic Research Fund (Tier 1 RT5/23)
- Singapore Ministry of Education Academic Research Fund (Tier 1 RG90/22)
- Nanyang Technological University (NTU)-Wallenberg AI, Autonomous Systems and Software Program (WASP) Joint Project
- Imperial-Nanyang Technological University Collaboration Fund (INCF-2024-008)
- Imperial-Nanyang Technological University Collaboration Fund (INCF-2025-009)
- Seatrium New Energy Laboratory Fund (03INS002302C130)
- national research foundation, prime minister’s office, singapore under its campus for research excellence and technological enterprise (create) program
- Shanghai Jiao Tong University (SJTU) Startup Fund and SJTU School of Computer Science
This publication has 44 references indexed in Scilit:
- Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced dataFuture Generation Computer Systems, 2022
- Communication-efficient federated learningProceedings of the National Academy of Sciences of the United States of America, 2021
- Device Scheduling with Fast Convergence for Wireless Federated Learning2020
- Client-Edge-Cloud Hierarchical Federated Learning2020
- Artificial Neural Networks-Based Machine Learning for Wireless Networks: A TutorialIEEE Communications Surveys & Tutorials, 2019
- Distributed optimization with arbitrary local solversOptimization Methods and Software, 2017
- Exact penalty and error bounds in DC programmingJournal of Global Optimization, 2011
- Wireless Communications2005
- Convex Optimization2004
- Convergence of a Block Coordinate Descent Method for Nondifferentiable MinimizationJournal of Optimization Theory and Applications, 2001