CPPer-FL: Clustered Parallel Training for Efficient Personalized Federated Learning
- 15 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (10) , 9424-9436
Abstract
In this paper, a clustered parallel training algorithm is designed for personalized federated learning (Per-FL), called CPPer-FL. CPPer-FL improves the communication and training efficiency of Per-FL from two perspectives, namely, less burden for the central server and lower interaction idling delay. CPPer-FL adopts a client-edge-center learning architecture, which offloads the central server's model aggregation and communication burden to distributed edge servers. Also, CPPer-FL redesigns the cascading model synchronization and updating procedure in conventional Per-FL and changes it to a parallel manner, thus improving the interaction efficiency in the training process. Further, for the proposed hierarchical architecture, two approaches are proposed to cater to Per-FL: similarity-based clustering for client-edge association and personalized model aggregation for parallel model updating, such that clients' personal features can be preserved in the training process. The convergence of CPPer-FL has been formally analyzed and proved. Evaluation results validate the communication efficiency, model convergence, and model accuracy improvement.Keywords
Funding Information
- National Natural Science Foundation of China (62201077)
This publication has 35 references indexed in Scilit:
- Joint Model Pruning and Device Selection for Communication-Efficient Federated Edge LearningIEEE Transactions on Communications, 2021
- Buffer-Aware Virtual Reality Video Streaming With Personalized and Private Viewport PredictionIEEE Journal on Selected Areas in Communications, 2021
- Fast-Convergent Federated Learning With Adaptive WeightingIEEE Transactions on Cognitive Communications and Networking, 2021
- Fast Federated Learning by Balancing Communication Trade-OffsIEEE Transactions on Communications, 2021
- Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated LearningIEEE Transactions on Communications, 2021
- Deep Reinforcement Learning Assisted Federated Learning Algorithm for Data Management of IIoTIEEE Transactions on Industrial Informatics, 2021
- GSSP: Eliminating Stragglers Through Grouping Synchronous for Distributed Deep Learning in Heterogeneous ClusterIEEE Transactions on Cloud Computing, 2021
- Asynchronous Stochastic Gradient Descent Over Decentralized DatasetsIEEE Transactions on Control of Network Systems, 2021
- MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing2020
- Adaptive Federated Learning in Resource Constrained Edge Computing SystemsIEEE Journal on Selected Areas in Communications, 2019