FedASA: A Personalized Federated Learning With Adaptive Model Aggregation for Heterogeneous Mobile Edge Computing
- 20 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (12) , 14787-14802
Abstract
Federated learning (FL) opens a new promising paradigm for the Industrial Internet of Things (IoT) since it can collaboratively train machine learning models without sharing private data. However, deploying FL frameworks in real IoT scenarios faces three critical challenges, i.e., statistical heterogeneity, resource constraint, and fairness. To address these challenges, we design a fair and efficient FL method, termed FedASA, which can address the challenge of statistical heterogeneity in resource-constrained scenarios by determining the shared architecture adaptively. In FedASA, we first present a cell-wised shared architecture selection strategy, which can adaptively construct the shared architecture for each device. We then design a cell-based aggregation algorithm for aggregating heterogeneous shared architectures. In addition, we provide a theoretical analysis of the federated error bound, which provides a theoretical guarantee for the fairness. At the same time, we prove the convergence of FedASA at the first-order stationary point. We evaluate the performance of FedASA through extensive simulation and experiments. Experimental results in cross-location scenarios show that FedASA outperformed the state-of-the-art approaches, improving accuracy by up to 13.27% with better fairness and faster convergence and communication requirement has been reduced by 81.49%.Keywords
Funding Information
- National Natural Science Foundation of China (62172003, 92167204, 62072030, 62302539)
- University Synergy Innovation Program of Anhui Province (GXXT-2022-051)
- Open Fund of Anhui Engineering Research Center for Intelligent Applications and Security of Industrial Internet (IASII24-01)
- China Postdoctoral Science Foundation (2024T170047, GZC20230223, 2024M750165)
- National Research Foundation Singapore
- Info-communications Media Development Authority
- Future Communications Research & Development Programme, Defence Science Organisation (DSO) National Laboratories under the AI Singapore Programme (FCP-NTU RG-2022-010, FCP-ASTAR-TG-2022-003)
- Ministry of Education - Singapore (RG87/22)
- NTU Centre for Computational Technologies in Finance
This publication has 36 references indexed in Scilit:
- A federated learning approach to mixed fault diagnosis in rotating machineryJournal of Manufacturing Systems, 2023
- Low-cost mobile augmented reality service for building information modelingAutomation in Construction, 2022
- Layer-wised Model Aggregation for Personalized Federated Learning2022
- Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation2021
- Meta-learning for few-shot bearing fault diagnosis under complex working conditionsNeurocomputing, 2021
- Federated learning for machinery fault diagnosis with dynamic validation and self-supervisionKnowledge-Based Systems, 2021
- Edge Computing in Industrial Internet of Things: Architecture, Advances and ChallengesIEEE Communications Surveys & Tutorials, 2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020
- Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark studyMechanical Systems and Signal Processing, 2015
- A theory of learning from different domainsMachine Learning, 2009