Personalized federated learning for heterogeneous data: A distributed edge clustering approach
Open Access
- 1 January 2023
- journal article
- research article
- Published by American Institute of Mathematical Sciences (AIMS) in Mathematical Biosciences and Engineering
- Vol. 20 (6) , 10725-10740
Abstract
Federated learning (FL) is a distributed machine learning technique that allows multiple devices (e.g., smartphones and IoT devices) to collaborate in the training of a shared model with each device preserving the privacy of its local data. However, the highly heterogeneous distribution of data among clients in FL can result in poor convergence. In addressing this issue, the concept of personalized federated learning (PFL) has emerged. PFL aims to tackle the effects of non-independent and identically distributed data and statistical heterogeneity and to achieve personalized models with rapid model convergence. One approach is clustering-based PFL, which utilizes group-level client relationships to achieve personalization. However, this method still relies on a centralized approach, whereby the server coordinates all processes. To address these shortcomings, this study introduces a blockchain-enabled distributed edge cluster for PFL (BPFL) that combines the benefits of blockchain and edge computing. Blockchain technology can be used to enhance client privacy and security by recording transactions on immutable distributed ledger networks, thereby improving client selection and clustering. The edge computing system offers reliable storage and computation such that computational processing is locally performed in the edge infrastructure to be closer to clients. Thus, the real-time services and low-latency communication of PFL are improved. However, further work is required to develop a representative dataset for the examination of related types of attacks and defenses for a robust BPFL protocol.Keywords
This publication has 21 references indexed in Scilit:
- Clustered Federated Learning: Model-Agnostic Distributed Multitask Optimization Under Privacy ConstraintsIEEE Transactions on Neural Networks and Learning Systems, 2020
- FedHealth: A Federated Transfer Learning Framework for Wearable HealthcareIEEE Intelligent Systems, 2020
- An Overview on Edge Computing ResearchIEEE Access, 2020
- DeepChain: Auditable and Privacy-Preserving Deep Learning with Blockchain-based IncentiveIEEE Transactions on Dependable and Secure Computing, 2019
- Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge ComputingProceedings of the IEEE, 2019
- Federated Learning for Ultra-Reliable Low-Latency V2V Communications2018
- Federated learning of predictive models from federated Electronic Health RecordsInternational Journal of Medical Informatics, 2018
- The EU General Data Protection Regulation (GDPR)2017
- HIPAA Regulations — A New Era of Medical-Record Privacy?New England Journal of Medicine, 2003
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998