Edge-to-Cloud Federated Learning with Resource-Aware Model Aggregation in MEC
Authors:
- 9 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 347-352
Abstract
The rapid increase in the number of connected devices paired with the adoption of Machine Learning (ML) applications dramatically augments the computation and communication requirements imposed on today's telecommunication networks. New ML techniques and networking paradigms such as Federated Learning (FL), Multi-access Edge Computing (MEC), and Software-Defined Wide Area Networks (SD-WANs) are needed to cope with these requirements. However, to run FL in MEC SD-WANs, intelligent resource management strategies and an evaluation of the impact of FL on the network resources are necessary. In this work, we discuss online resource management strategies for FL model aggregation enhanced by intermediate aggregation at edge nodes. Our analysis shows that a layer of intermediate aggregators (edge aggregators) alleviates the traffic on network links and allows us to take advantage of edge computing nodes, but the risk of congestion in the back-haul network is still high. We thus propose a new aggregation scenario deploying an aggregator overlay network and present an algorithm optimizing the routing of edge aggregators. Our proposed solution can adapt better to resource utilization in the network, achieving a decrease of the failure rate of FL training rounds by up to 15 percent while reducing cloud link congestion.Keywords
This publication has 23 references indexed in Scilit:
- Resource management at the network edge for federated learningDigital Communications and Networks, 2024
- Bandwidth constrained client selection and scheduling for federated learning over SD‐WANIET Communications, 2022
- A dataset for mobile edge computing network topologiesData in Brief, 2021
- BigDataSDNSim: A simulator for analyzing big data applications in software-defined cloud data centersSoftware: Practice and Experience, 2021
- Edge computing: current trends, research challenges and future directionsComputing, 2021
- Multi-Access Edge Computing: A SurveyIEEE Access, 2020
- IoTSim-SDWAN: A simulation framework for interconnecting distributed datacenters over Software-Defined Wide Area Network (SD-WAN)Journal of Parallel and Distributed Computing, 2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020
- EdgeCloudSim: An environment for performance evaluation of Edge Computing systems2017
- CloudSimSDN: Modeling and Simulation of Software-Defined Cloud Data Centers2015