Federated Deep Reinforcement Learning for Joint AeBSs Deployment and Computation Offloading in Aerial Edge Computing Network
Open Access
- 7 November 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (21) , 3641
Abstract
In the 6G aerial network, all aerial communication nodes have computing and storage functions and can perform real-time wireless signal processing and resource management. In order to make full use of the computing resources of aerial nodes, this paper studies the mobile edge computing (MEC) system based on aerial base stations (AeBSs), proposes the joint optimization problem of computation the offloading and deployment control of AeBSs for the goals of the lowest task processing delay and energy consumption, and designs a deployment and computation offloading scheme based on federated deep reinforcement learning. Specifically, each low-altitude AeBS agent simultaneously trains two neural networks to handle the generation of the deployment and offloading strategies, respectively, and a high-altitude global node aggregates the local model parameters uploaded by each low-altitude platform. The agents can be trained offline and updated quickly online according to changes in the environment and can quickly generate the optimal deployment and offloading strategies. The simulation results show that our method can achieve good performance in a very short time.Keywords
Funding Information
- National Key R&D Program of China (2020YFB1806700)
This publication has 42 references indexed in Scilit:
- Design Challenges of Multi-UAV Systems in Cyber-Physical Applications: A Comprehensive Survey and Future DirectionsIEEE Communications Surveys & Tutorials, 2019
- Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge ComputingProceedings of the IEEE, 2019
- Learning-Based Computation Offloading for IoT Devices With Energy HarvestingIEEE Transactions on Vehicular Technology, 2019
- Distributed Deep Learning-based Offloading for Mobile Edge Computing NetworksMobile Networks and Applications, 2018
- Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement LearningIEEE Internet of Things Journal, 2018
- Task Offloading for UAV-based Mobile Edge Computing via Deep Reinforcement Learning2018
- UAV-Enabled Mobile Edge Computing: Offloading Optimization and Trajectory Design2018
- Improvement of Generalization Ability of Deep CNN via Implicit Regularization in Two-Stage Training ProcessIEEE Access, 2018
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Mobile Edge Computing via a UAV-Mounted Cloudlet: Optimization of Bit Allocation and Path PlanningIEEE Transactions on Vehicular Technology, 2017