Federated Learning Over Wireless IoT Networks With Optimized Communication and Resources
Top Cited Papers
- 14 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (17) , 16592-16605
Abstract
To leverage massive distributed data and computation resources, machine learning in the network edge is considered to be a promising technique, especially for large-scale model training. Federated learning (FL), as a paradigm of collaborative learning techniques, has obtained increasing research attention with the benefits of communication efficiency and improved data privacy. Due to the lossy communication channels and limited communication resources (e.g., bandwidth and power), it is of interest to investigate fast responding and accurate FL schemes over wireless systems. Hence, we investigate the problem of jointly optimized communication efficiency and resources for FL over wireless Internet of Things (IoT) networks. To reduce complexity, we divide the overall optimization problem into two subproblems, i.e., the client scheduling problem and the resource allocation problem. To reduce the communication costs for FL in wireless IoT networks, a new client scheduling policy is proposed by reusing stale local model parameters. To maximize successful information exchange over networks, a Lagrange multiplier method is first leveraged by decoupling variables, including power variables, bandwidth variables, and transmission indicators. Then, a linear-search-based power and bandwidth allocation method is developed. Given appropriate hyperparameters, we show that the proposed communication-efficient FL (CEFL) framework converges at a strong linear rate. Through extensive experiments, it is revealed that the proposed CEFL framework substantially boosts both the communication efficiency and learning performance of both training loss and test accuracy for FL over wireless IoT networks compared to a basic FL approach with uniform resource allocation.Keywords
Funding Information
- ERA-NET Smart Energy Systems SG+ 2017 Program through “SMART-MLA” Project (89029, 42811-2)
- FORMAS Project titled “Intelligent Energy Management in Smart Community with Distributed Machine Learning” (2021-00306)
- Swedish Research Council Project titled “Coding for Large-Scale Distributed Machine Learning” (2021-04772)
- Digital Futures Postdoc Fellowships
This publication has 40 references indexed in Scilit:
- Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge2019
- Data collection using unmanned aerial vehicles for Internet of Things platformsComputers and Electrical Engineering, 2019
- Federated Learning over Wireless Networks: Optimization Model Design and Analysis2019
- Communication-efficient algorithms for decentralized and stochastic optimizationMathematical Programming, 2018
- IoT-Based Smart Edge for Global Health: Remote Monitoring With Severity Detection and Alerts TransmissionIEEE Internet of Things Journal, 2018
- Wireless Powered Dense Cellular Networks: How Many Small Cells Do We Need?IEEE Journal on Selected Areas in Communications, 2017
- Energy Efficient Resource Allocation in D2D-Assisted Heterogeneous Networks with RelaysIEEE Access, 2016
- Managing Contingencies in Smart Grids via the Internet of ThingsIEEE Transactions on Smart Grid, 2016
- Smart Direct-LTE communication: An energy saving perspectiveAd Hoc Networks, 2014
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998