Adaptive Training and Aggregation for Federated Learning in Multi-Tier Computing Networks
- 27 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (5) , 4376-4388
Abstract
Multi-tier computing (MC) utilizes computing resources from the cloud, fog, edge, and end layers to promote intelligent Internet of Things (IoT) applications. Federated learning (FL) in MC offers a prospective distributed and privacy-preserving framework to deploy deep learning applications in different layers. Due to time-varying network topologies, wireless channel states, and computational workloads, MC faces a dynamic and uncertain environment, which poses additional challenges to FL task processing. In this paper, we propose a novel adaptive training and aggregation federated learning (ATAFL) framework. Specifically, local model training can be performed at end devices, edge nodes, and fog nodes. The global aggregator can choose from the edge, fog, and cloud layers. A joint optimization problem of training, aggregation node selection, and resource allocation is further formulated to minimize system latency and energy consumption. Moreover, digital twin and deep reinforcement learning (DRL) techniques are integrated into the MC network to design optimal node selection and resource allocation strategies based on captured state information of the MC system. We implement a prototype, and experimental results show that our proposed DRL-based algorithm reduces system latency and energy consumption compared with the benchmark algorithms.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFB1803204)
This publication has 37 references indexed in Scilit:
- Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based NetworksIEEE Internet of Things Journal, 2021
- FogFL: Fog-Assisted Federated Learning for Resource-Constrained IoT DevicesIEEE Internet of Things Journal, 2020
- Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of ThingsIEEE Internet of Things Journal, 2020
- Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020
- Artificial Neural Networks-Based Machine Learning for Wireless Networks: A TutorialIEEE Communications Surveys & Tutorials, 2019
- Deep Deterministic Policy Gradient (DDPG)-Based Energy Harvesting Wireless CommunicationsIEEE Internet of Things Journal, 2019
- Multi-tier computing networks for intelligent IoTNature Electronics, 2019
- Survey of Fog Computing: Fundamental, Network Applications, and Research ChallengesIEEE Communications Surveys & Tutorials, 2018
- A Survey on Network Methodologies for Real-Time Analytics of Massive IoT Data and Open Research IssuesIEEE Communications Surveys & Tutorials, 2017