Fast Adaptive Task Offloading and Resource Allocation in Large-Scale MEC Systems via Multiagent Graph Reinforcement Learning
- 14 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (1) , 758-776
Abstract
In multi-access edge computing, when many mobile devices (MDs) offload their tasks to an edge server (ES), its resources might become constrained. These tasks may take a long time to complete or even be thrown away. Since the unknown information of both the ESs and other MDs, it is difficult for each MD to determine its offloading policy independently. Furthermore, most offloading methods have poor generalization to new environment since they focus on model architecture with a fixed quantity of MDs and ESs, preventing trained models from transferring to other environments. In the paper, we provide a full decentralized offloading scheme based on the Curriculum Attention-weighted Graph Recurrent Network-based Multi-Agent Actor-Critic (CAGR-MAAC). First, we build MEC as a shared MD agents-ESs graph and an AGR-based message network is designed to enable each MD aggregate the information of ESs and other MDs and solve the partial observability of MD agents for MEC system. Second, a learnable differentiable encoder network is introduced to construct MD agent’s local information encoding. Subsequently, the MD agent converts overall the information regarding the MEC system into a fixed-size embedding via an AGR Network to handle different quantity of MDs and ESs. Finally, we introduce curriculum learning to address the huge complexity of the MEC system and the training difficulties induced by the large amounts of MDs and ESs. Experiments demonstrate that compared with existing algorithms, CAGR-MAAC boosts task completion rates and decreases system costs by 13.01% 15.03% and 16.45% 18.56%, and can quickly adapt to the new environment.Keywords
Funding Information
- National Key Research and Development Plan of China (2021YFF0901205)
This publication has 49 references indexed in Scilit:
- Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing SystemsIEEE Transactions on Mobile Computing, 2020
- Multi-Agent Reinforcement Learning Based Resource Management in MEC- and UAV-Assisted Vehicular NetworksIEEE Journal on Selected Areas in Communications, 2020
- EEDTO: An Energy-Efficient Dynamic Task Offloading Algorithm for Blockchain-Enabled IoT-Edge-Cloud Orchestrated ComputingIEEE Internet of Things Journal, 2020
- Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of ThingsIEEE Transactions on Industrial Informatics, 2020
- Fast Adaptive Task Offloading in Edge Computing Based on Meta Reinforcement LearningIEEE Transactions on Parallel and Distributed Systems, 2020
- Heterogeneous Task Offloading and Resource Allocations via Deep Recurrent Reinforcement Learning in Partial Observable Multifog NetworksIEEE Internet of Things Journal, 2020
- Multiagent Deep Reinforcement Learning for Joint Multichannel Access and Task Offloading of Mobile-Edge Computing in Industry 4.0IEEE Internet of Things Journal, 2020
- Deep-Reinforcement-Learning-Based Offloading Scheduling for Vehicular Edge ComputingIEEE Internet of Things Journal, 2020
- Dynamic Task Offloading in Multi-Agent Mobile Edge Computing Networks2019
- iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT NetworksIEEE Internet of Things Journal, 2019