Toward Multiple Federated Learning Services Resource Sharing in Mobile Edge Networks
Open Access
- 2 June 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 22 (1) , 541-555
Abstract
Federated Learning is a new learning scheme for collaborative training a shared prediction model while keeping data locally on participating devices. In this paper, we study a new model of multiple federated learning services at the multi-access edge computing server. Accordingly, the sharing of CPU resources among learning services at each mobile device for the local training process and allocating communication resources among mobile devices for exchanging learning information must be considered. Furthermore, the convergence performance of different learning services depends on the hyper-learning rate parameter that needs to be precisely decided. Towards this end, we propose a joint resource optimization and hyper-learning rate control problem, namely ${{\sf MS-FEDL}}$ , regarding the energy consumption of mobile devices and overall learning time. We design a centralized algorithm based on the block coordinate descent method and a decentralized JP-miADMM algorithm for solving the ${{\sf MS-FEDL}}$ problem. Different from the centralized approach, the decentralized approach requires many iterations to obtain but it allows each learning service to independently manage the local resource and learning process without revealing the learning service information. Our simulation results demonstrate the convergence performance of our proposed algorithms and the superior performance of our proposed algorithms compared to the heuristic strategy.
Keywords
All Related Versions
Funding Information
- National Research Foundation of Korea (2020R1A4A1018607)
- Institute of Information and Communications Technology Planning and Evaluation (2019-0-01287)
This publication has 28 references indexed in Scilit:
- CrowdTracker: Optimized Urban Moving Object Tracking Using Mobile Crowd SensingIEEE Internet of Things Journal, 2017
- DeepEye2017
- Semi-stochastic coordinate descentOptimization Methods and Software, 2017
- Distributed optimization with arbitrary local solversOptimization Methods and Software, 2017
- Parallel Multi-Block ADMM with o(1 / k) ConvergenceJournal of Scientific Computing, 2016
- On the Global Linear Convergence of the ADMM with MultiBlock VariablesSIAM Journal on Optimization, 2015
- A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and CompletionSIAM Journal on Imaging Sciences, 2013
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- Processor Design for Portable Systems1996