GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning
Authors:
- 1 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5018-5028
Abstract
Federated Learning (FL) is popular for its privacy-preserving and collaborative learning capabilities. Recently, personalized FL (pFL) has received attention for its ability to address statistical heterogeneity and achieve personalization in FL. However, from the perspective of feature extraction, most existing pFL methods only focus on extracting global or personalized feature information during local training, which fails to meet the collaborative learning and personalization goals of pFL. To address this, we propose a new pFL method, named GPFL, to simultaneously learn global and personalized feature information on each client. We conduct extensive experiments on six datasets in three statistically heterogeneous settings and show the superiority of GPFL over ten state-of-the-art methods regarding effectiveness, scalability, fairness, stability, and privacy. Besides, GPFL mitigates overfitting and outperforms the baselines by up to 8.99% in accuracy.Keywords
All Related Versions
Funding Information
- China Aerospace Science and Technology Corporation
- Science and Technology Commission of Shanghai Municipality
This publication has 32 references indexed in Scilit:
- Federated recommenders: methods, challenges and futureCluster Computing, 2022
- FedPHP: Federated Personalization with Inherited Private Models2021
- TLSAN: Time-aware long- and short-term attention network for next-item recommendationNeurocomputing, 2021
- Deep Leakage from Gradients2020
- Federated Visual Classification with Real-World Data Distribution2020
- Secure, privacy-preserving and federated machine learning in medical imagingNature Machine Intelligence, 2020
- Learning Loss for Active Learning2019
- BlockDrop: Dynamic Inference Paths in Residual Networks2018
- Deep Residual Learning for Image Recognition2016
- Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine2012