Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing
Authors:
- 25 September 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 28-36
Abstract
Collaborative edge computing (CEC) has emerged as a promising paradigm, enabling edge nodes to collaborate and execute microservices from end devices. Microservice offloading, a fundamentally important problem, decides when and where microservices are executed upon the arrival of services. However, the dynamic nature of the real-world CEC environment often leads to inefficient microservice offloading strategies, resulting in underutilized resources and network congestion. To address this challenge, we formulate an online joint microservice offloading and bandwidth allocation problem, JMOBA, to minimize the average completion time of services. In this paper, we introduce a novel microservice offloading algorithm, DTDRLMO, which leverages deep reinforcement learning (DRL) and digital twin technology. Specifically, we employ digital twin techniques to predict and adapt to changing edge node loads and network conditions of CEC in real-time. Furthermore, this approach enables the generation of an efficient offloading plan, selecting the most suitable edge node for each microservice. Simulation results on real-world and synthetic datasets demonstrate that DTDRLMO outperforms heuristic and learning-based methods in average service completion time.Keywords
All Related Versions
Funding Information
- Impact Fund
This publication has 24 references indexed in Scilit:
- Dyme: Dynamic Microservice Scheduling in Edge Computing Enabled IoTIEEE Internet of Things Journal, 2020
- A Deep Reinforcement Learning Based Offloading Game in Edge ComputingIEEE Transactions on Computers, 2020
- Delay-Aware Microservice Coordination in Mobile Edge Computing: A Reinforcement Learning ApproachIEEE Transactions on Mobile Computing, 2019
- OnDisc: Online Latency-Sensitive Job Dispatching and Scheduling in Heterogeneous Edge-CloudsIEEE/ACM Transactions on Networking, 2019
- Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing NetworksIEEE Transactions on Mobile Computing, 2019
- Dedas: Online Task Dispatching and Scheduling with Bandwidth Constraint in Edge Computing2019
- Joint Task Offloading and Resource Allocation for Multi-Server Mobile-Edge Computing NetworksIEEE Transactions on Vehicular Technology, 2018
- Energy-Efficient Joint Offloading and Wireless Resource Allocation Strategy in Multi-MEC Server Systems2018
- Digital twin-driven product design, manufacturing and service with big dataThe International Journal of Advanced Manufacturing Technology, 2017
- A survey of algorithms for the generalized assignment problemEuropean Journal of Operational Research, 1992