Offloading Strategy Based on Graph Neural Reinforcement Learning in Mobile Edge Computing
Open Access
- 18 June 2024
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 13 (12) , 2387
Abstract
In the mobile edge computing (MEC) architecture, base stations with computational capabilities are subject to service coverage limitations, and the mobility of devices leads to dynamic changes in their connections, directly impacting the offloading decisions of agents. The connections between base stations and mobile devices, as well as the connections between base stations themselves, are abstracted into an MEC structural diagram due to the difficulty of deep reinforcement learning (DRL) in capturing the complex relationships between nodes and their multi-order neighboring nodes in the graph; decisions solely generated by DRL have limitations. To address this issue, this study proposes a hierarchical mechanism strategy based on Graph Neural Reinforcement Learning (M-GNRL) under multiple constraints. Specifically, the MEC structural graph constructed with the current device as an observation point aggregates to learn node features, thus comprehensively considering the contextual information of nodes, and the learned graph information serves as the environment for deep reinforcement learning, effectively integrating a graph neural network (GNN) with DRL. In the M-GNRL strategy, edge features from GNN are introduced into the architecture of the DRL network to enhance the accuracy of agents’ decision-making. Additionally, this study proposes an updated algorithm to obtain graph data that change with observation points. Comparative experiments demonstrate that the M-GNRL algorithm outperforms other baseline algorithms in terms of system cost and convergence performance.Keywords
Funding Information
- 2023 Opening Research Fund of Yunnan Key Laboratory of Digital Communications (YNJTKFB-20230686, YNKLDC-KFKT-202304, 202202AE090019)
- Yunnan Provincial Major Science and Technology Project (YNJTKFB-20230686, YNKLDC-KFKT-202304, 202202AE090019)
This publication has 31 references indexed in Scilit:
- Deep-Graph-Based Reinforcement Learning for Joint Cruise Control and Task Offloading for Aerial Edge Internet of Things (EdgeIoT)IEEE Internet of Things Journal, 2022
- Graph-Reinforcement-Learning-Based Task Offloading for Multiaccess Edge ComputingIEEE Internet of Things Journal, 2021
- A GNN-Based Supervised Learning Framework for Resource Allocation in Wireless IoT NetworksIEEE Internet of Things Journal, 2021
- Distributed task offloading strategy to low load base stations in mobile edge computing environmentComputer Communications, 2020
- To Improve Service Reliability for AI-Powered Time-Critical Services Using Imperfect Transmission in MEC: An Experimental StudyIEEE Internet of Things Journal, 2020
- Optimization of lightweight task offloading strategy for mobile edge computing based on deep reinforcement learningFuture Generation Computer Systems, 2020
- Computation Offloading in Multi-Access Edge Computing Using a Deep Sequential Model Based on Reinforcement LearningIEEE Communications Magazine, 2019
- Mobile cloud computing: Challenges and future research directionsJournal of Network and Computer Applications, 2018
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Wireless sensor network surveyComputer Networks, 2008