Abstract
Federated Learning (FL) is a sophisticated decentralized approach in machine learning, where individual user devices perform model training locally and then transmit their parameters to a central server. This paper delves into the dynamics of a hierarchical FL system, particularly focusing on the intricate exchange of model parameters between cloud and edge servers, and between edge servers and user devices. The capacity of this hierarchical FL model to achieve predefined global model accuracy is significantly influenced by delays in communication and computation of model parameters. To address these challenges and balance the trade-off between energy consumption and execution time, we formulate a comprehensive joint computation and communication resource optimization problem. This problem is aimed at minimizing the weighted sum of FL completion time and total energy consumption, enhancing overall system efficiency. The problem is methodically decomposed into four sub-problems. The initial three sub-problems utilize fractional programming techniques to find efficient solutions that optimize resource allocation. For the final sub-problem, we employ the Concave-Convex Procedure (CCCP), which is well-suited for dealing with the non-linear aspects of the optimization challenge. We then discuss the computational complexity and give the convergence analysis of the proposed approach. Simulation results underline the effectiveness of our approach, showing faster convergence of the global model under optimized communication and computation conditions. These results clearly demonstrate the beneficial trade-off between FL completion time and energy consumption, indicating that our optimization strategy successfully enhances the performance in hierarchical federated learning systems.
Funding Information
  • National Research Foundation, Singapore, and Infocomm Media Development Authority under its Trust Tech Funding Initiative
  • National Research Foundation, Singapore, under its Strategic Capability Research Centres Funding Initiative
  • Singapore Ministry of Education Academic Research Fund (Tier 1 RT5/23)
  • Singapore Ministry of Education Academic Research Fund (Tier 1 RG90/22)
  • Nanyang Technological University (NTU)-Wallenberg AI, Autonomous Systems and Software Program (WASP) Joint Project
  • Imperial-Nanyang Technological University Collaboration Fund (INCF-2024-008)
  • Imperial-Nanyang Technological University Collaboration Fund (INCF-2025-009)
  • Seatrium New Energy Laboratory Fund (03INS002302C130)
  • national research foundation, prime minister’s office, singapore under its campus for research excellence and technological enterprise (create) program
  • Shanghai Jiao Tong University (SJTU) Startup Fund and SJTU School of Computer Science

This publication has 44 references indexed in Scilit: