Multiagent Reinforcement Learning for Task Offloading of Space/Aerial-Assisted Edge Computing
Authors:
Open Access
- 2 May 2022
- journal article
- research article
- Published by Wiley in Security and Communication Networks
- Vol. 2022, 1-10
Abstract
The task offloading in space-aerial-ground integrated network (SAGIN) has been envisioned as a challenging issue. In this paper, we investigate a space/aerial-assisted edge computing network architecture considering whether to take advantage of edge server mounted on the unmanned aerial vehicle and satellite for task offloading or not. By optimizing the energy consumption and completion delay, we formulate a NP-hard and non-convex optimization problem to minimize the computation cost, limited by the computation capacity and energy availability constraints. By formulating the problem as a Markov decision process (MDP), we propose a multiagent deep reinforcement learning (MADRL)-based scheme to obtain the optimal task offloading policies considering dynamic computation request and stochastic time-varying channel conditions, while ensuring the quality-of-service requirements. Finally, simulation results demonstrate the task offloading scheme learned from our proposed algorithm that can substantially reduce the average cost as compared to the other three single agent deep reinforcement learning schemes.Keywords
Funding Information
- National Natural Science Foundation of China (61761014, CRKL190109)
- Guilin University of Electronic Technology Ministry of Education Key Laboratory of Cognitive Radio and Information Processing (61761014, CRKL190109)
This publication has 27 references indexed in Scilit:
- A greedy algorithm for task offloading in mobile edge computing systemChina Communications, 2018
- Air-Ground Integrated Mobile Edge Networks: Architecture, Challenges, and OpportunitiesIEEE Communications Magazine, 2018
- Space-Air-Ground Integrated Network: A SurveyIEEE Communications Surveys & Tutorials, 2018
- Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation OffloadingIEEE Transactions on Wireless Communications, 2018
- Multiple Drone-Cell Deployment Analyses and Optimization in Drone Assisted Radio Access NetworksIEEE Access, 2018
- Optimal Schedule of Mobile Edge Computing for Internet of Things Using Partial InformationIEEE Journal on Selected Areas in Communications, 2017
- Designing and implementing future aerial communication networksIEEE Communications Magazine, 2016
- Dynamic Spectrum Access in Multi-Channel Cognitive Radio NetworksIEEE Journal on Selected Areas in Communications, 2014
- Optimal LAP Altitude for Maximum CoverageIEEE Wireless Communications Letters, 2014
- Channel Model for Satellite Communication Links Above 10GHz Based on Weibull DistributionIEEE Communications Letters, 2014