Fairness-Aware Federated Learning With Unreliable Links in Resource-Constrained Internet of Things
- 3 March 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (18) , 17359-17371
Abstract
In order to make full use of the network data and guarantee user privacy simultaneously, federated learning (FL) is proposed to enable distributed intelligence for local nodes without sharing data with each other. However, in practice, due to resource limitations, traditional FL suffers from node scheduling and parameter transmission failure, which not only affects the final performance but also further reduces the fairness of the participating nodes. This article addresses the challenge and proposes an FL method to enhance the performance of FL on the basis of guaranteeing the fairness of the local nodes in a resource-constrained Internet of Things (IoT) network. Specifically, an analytical model is first constructed to characterize the performance of FL with joint considerations of node fairness, unreliable parameter transmissions as well as resource limitations. Thereafter, a statistically reweighted aggregation (SRA) scheme is proposed for parameter aggregation and the corresponding model is proved to be unbiased to that based on ideal parameter transmissions. With the knowledge of time dependency of the global model, we further extend SRA and propose a reliable SRA (RSRA) scheme. Additionally, we prove RSRA is able to achieve higher stability performance than SRA in model training. Furthermore, the convergence bound of the proposed RSRA is derived analytically, based on which an adaptive local training scheme is proposed under a given resource budget. Finally, extensive experiments are carried out with a public data set to validate the effectiveness of the proposed scheme with comparisons of other baseline schemes.Keywords
Funding Information
- National Natural Science Foundation of China (61901078, 61871062, U20A20157)
- China University Industry-University-Research Collaborative Innovation Fund (2021FNA04008)
- Natural Science Foundation of Chongqing Municipality (cstc2020jcyj-zdxmX0024)
- University Innovation Research Group of Chongqing (CXQT20017)
- 2019 Industrial Internet Innovation and Development Project Software Defined Industrial Internet Identification Data Management System
- 2020 Industrial Internet Innovation and Development Project Regional Integration Industrial Internet Public Service Platform
This publication has 8 references indexed in Scilit:
- Federated Learning in Unreliable and Resource-Constrained Cellular Wireless NetworksIEEE Transactions on Communications, 2021
- Fast-Convergent Federated LearningIEEE Journal on Selected Areas in Communications, 2020
- Performance Optimization of Federated Learning over Wireless Networks2019
- Scheduling Policies for Federated Learning in Wireless NetworksIEEE Transactions on Communications, 2019
- Federated Learning over Wireless Networks: Optimization Model Design and Analysis2019
- Adaptive Federated Learning in Resource Constrained Edge Computing SystemsIEEE Journal on Selected Areas in Communications, 2019
- Fog and IoT: An Overview of Research OpportunitiesIEEE Internet of Things Journal, 2016
- Distributed delayed stochastic optimization2012