Toward Cooperative Federated Learning Over Heterogeneous Edge/Fog Networks
Authors:
- 8 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 61 (12) , 54-60
Abstract
Federated learning (FL) has been promoted as a popular technique for training machine learning (ML) models over edge/fog networks. Traditional implementations of FL have largely neglected the potential for inter-network cooperation, treating edge/fog devices and other infrastructure participating in ML as separate processing elements. Consequently, FL has been vulnerable to several dimensions of network heterogeneity, such as varying computation capabilities, communication resources, data qualities, and privacy demands. We advocate for cooperative federated learning (CFL), a cooperative edge/fog ML paradigm built on device-to-device (D2D) and device-toserver (D2S) interactions. Through D2D and D2S cooperation, CFL counteracts network heterogeneity in edge/fog networks through enabling a model/data/resource pooling mechanism, which will yield substantial improvements in ML model training quality and network resource consumption. We propose a set of core methodologies that form the foundation of D2D and D2S cooperation and present preliminary experiments that demonstrate their benefits. We also discuss new FL functionalities enabled by this cooperative framework such as the integration of unlabeled data and heterogeneous device privacy into ML model training. Finally, we describe some open research directions at the intersection of cooperative edge/fog and FL.Keywords
All Related Versions
Funding Information
- National Science Foundation (CNS-2146171)
- DARPA (D22AP00168-00)
This publication has 13 references indexed in Scilit:
- Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System HeterogeneityIEEE Journal on Selected Areas in Information Theory, 2022
- Recent Advances in Artificial Intelligence for Wireless Internet of Things and Cyber–Physical Systems: A Comprehensive SurveyIEEE Internet of Things Journal, 2022
- Data Heterogeneity-Robust Federated Learning via Group Client Selection in Industrial IoTIEEE Internet of Things Journal, 2022
- A Novel Framework for the Analysis and Design of Heterogeneous Federated LearningIEEE Transactions on Signal Processing, 2021
- Secure and Efficient Federated Learning for Smart Grid With Edge-Cloud CollaborationIEEE Transactions on Industrial Informatics, 2021
- Advances and Open Problems in Federated LearningFoundations and Trends in Machine Learning, 2021
- Self-Supervised Pillar Motion Learning for Autonomous Driving2021
- Friend-as-Learner: Socially-Driven Trustworthy and Efficient Wireless Federated Edge LearningIEEE Transactions on Mobile Computing, 2021
- Opportunities of Federated Learning in Connected, Cooperative, and Automated Industrial SystemsIEEE Communications Magazine, 2021
- A Framework for Cooperative Resource Management in Mobile Cloud ComputingIEEE Journal on Selected Areas in Communications, 2013