Abstract
We consider decentralized federated learning (DFL) in mobile computing networks (MCNs), where dynamically changing neighborhood sets among devices arise from mobility and environmental perturbations. The time-varying topology coupled with inherent system heterogeneity poses significant challenges to achieve stable and efficient convergence in DFL. However, existing studies rarely consider both dynamic connectivity and statistical heterogeneity. To close this gap, this paper proposes a novel DFL framework enhanced with topology learning (DFL-TL) to mitigate the spatio-temporal volatility induced by MCNs, where each mobile device faces coupled constraints on its temporal windows for local updates and spatial scopes for model interaction. We introduce a new bounded neighborhood heterogeneity to jointly measure and constrain both the inter-device heterogeneity and the spectral properties of the topologies. Additionally, we formulate a mixed-integer nonlinear programming (MINLP) problem to jointly optimize learning costs and neighborhood heterogeneity. Through problem decomposition, DFL-TL efficiently identifies optimal resource allocations and adaptive mixing matrices, thereby enabling the selection of optimal training time windows while reducing the adverse effects of dynamic topologies in heterogeneous networks. Furthermore, we establish the iteration complexity of DFL-TL under non-convex settings and show that solving the proposed MINLP formulation leads to a tighter convergence bound. Extensive experiments demonstrate that DFL-TL achieves a faster convergence performance and reduces the wall-clock training time compared to the state-of-the-art baselines.
Funding Information
  • National Natural Science Foundation of China (62276202)
  • Ministry of Education Joint Fund (8091B03072304)
  • China Postdoctoral Science Foundation (2023T160501)
  • Joint Funds of the Zhejiang Provincial Natural Science Foundation of China (LHZY24A010005)
  • National Sleep Foundation (ECCS-2302469)
  • Amazon
  • Japan Science and Technology Agency (JPMJAP2326)
  • National key laboratory of science and technology on space microwave (HTKJ2024KL504008)
  • SUTD-MOE Early Career Award