Confidence-Based Similarity-Aware Personalized Federated Learning for Autonomous IoT
- 29 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (7) , 13070-13081
Abstract
Federated learning facilitates collaborative model training in the autonomous IoT system while preserving the privacy of local data on IoT clients. Nonetheless, the inherent non-IID characteristic of local data leads to poor convergence of a global model. Moreover, the global model fails to satisfy the personalized task demands of all clients. To address the above issues, this paper studies client grouping and local model aggregation in federated learning from two perspectives: measure of client data distribution and distribution similarity among clients. To this end, a novel confidence-based similarity-aware personalized federated learning algorithm (FedCS) for personalized autonomous IoT is proposed by developing three key innovations, namely, a public average confidence (PAC) measure, a client grouping strategy with dynamic sampling (CGDS) and a sequential aggregated weight (SAW) strategy. Specifically, the PAC measure utilizes a public dataset on the server side to estimate the client’s data distribution, which promotes fair estimate of distribution similarity among clients while minimizing privacy risks. The CGDS strategy focuses on distribution similarity among clients and approximates the client grouping problem as an auxiliary task selection problem in multi-task learning. This strategy assigns a client into multiple groups and enables the valuable information from each client to circulate among multiple groups. The SAW strategy further incentivizes more similar clients within a group to share greater knowledge, and generates an adaptive aggregated weight for each client within a group. A thorough experiment on CIFAR10 and two healthcare benchmarks shows that FedCS achieves a superior performance.Keywords
Funding Information
- National Natural Science Foundation of China (61572225, 61972174, 62302196)
- National Social Science Foundation of China (22BTJ057)
- Guangzhou Basic and Applied Basic Research Project (SL2022A04J01519)
This publication has 31 references indexed in Scilit:
- MedMNIST v2 - A large-scale lightweight benchmark for 2D and 3D biomedical image classificationScientific Data, 2023
- Graph-regularized federated learning with shareable side informationKnowledge-Based Systems, 2022
- FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction2022
- Learning to Collaborate in Decentralized Learning of Personalized Models2022
- Layer-wised Model Aggregation for Personalized Federated Learning2022
- Federated Contrastive Learning for Volumetric Medical Image Segmentation2021
- FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems2021
- Federated learning with hierarchical clustering of local updates to improve training on non-IID data2020
- Optimizing Federated Learning on Non-IID Data with Reinforcement Learning2020
- Deep Residual Learning for Image Recognition2016