Computation Offloading in Multi-Access Edge Computing Using a Deep Sequential Model Based on Reinforcement Learning

Authors:
  • JWJin Wang
    Jin Wang
  • JHJia Hu
    Jia Hu
  • GMGeyong Min
    Geyong Min
  • WZWenhan Zhan
    Wenhan Zhan
  • QNQiang Ni
    Qiang Ni
  • NGNektarios Georgalas
    Nektarios Georgalas
Top Cited Papers
Publisher website
Google Scholar
Abstract
MEC is an emerging paradigm that utilizes computing resources at the network edge to deploy heterogeneous applications and services. In the MEC system, mobile users and enterprises can offload computation-intensive tasks to nearby computing resources to reduce latency and save energy. When users make offloading decisions, the task dependency needs to be considered. Due to the NP-hardness of the offloading problem, the existing solutions are mainly heuristic, and therefore have difficulties in adapting to the increasingly complex and dynamic applications. To address the challenges of task dependency and adapting to dynamic scenarios, we propose a new DRL-based offloading framework, which can efficiently learn the offloading policy uniquely represented by a specially designed S2S neural network. The proposed DRL solution can automatically discover the common patterns behind various applications so as to infer an optimal offloading policy in different scenarios. Simulation experiments were conducted to evaluate the performance of the proposed DRL-based method with different data transmission rates and task numbers. The results show that our method outperforms two heuristic baselines and achieves nearly optimal performance.

This publication has 11 references indexed in Scilit: