DeepEdge: A Deep Reinforcement Learning Based Task Orchestrator for Edge Computing
- 26 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 10 (1) , 538-552
Abstract
The improvements in the edge computing technology pave the road for diversified applications that demand real-time interaction. However, due to the mobility of the end-users and the dynamic edge environment, it becomes challenging to handle the task offloading with high performance. Moreover, since each application in mobile devices has different characteristics, a task orchestrator must be adaptive and have the ability to learn the dynamics of the environment. For this purpose, we develop a deep reinforcement learning based task orchestrator, DeepEdge, which learns to meet different task requirements without needing human interaction even under the heavily-loaded stochastic network conditions in terms of mobile users and applications. Given the dynamic offloading requests and time-varying communication conditions, we successfully model the problem as a Markov process and then apply the Double Deep Q-Network (DDQN) algorithm to implement DeepEdge. To evaluate the robustness of DeepEdge, we experiment with four different applications including image rendering, infotainment, pervasive health, and augmented reality in the network under various loads. Furthermore, we compare the performance of our agent with the four different task offloading approaches in the literature. Our results show that DeepEdge outperforms its competitors in terms of the percentage of satisfactorily completed tasks.Keywords
All Related Versions
Funding Information
- Turkish Directorate of Strategy and Budget (2007K12-873)
This publication has 31 references indexed in Scilit:
- Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement LearningIEEE Internet of Things Journal, 2018
- Spatial Intelligence toward Trustworthy Vehicular IoTIEEE Communications Magazine, 2018
- Deep reinforcement learning based computation offloading and resource allocation for MEC2018
- Computation offloading for mobile edge computing: A deep learning approach2017
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- How Can Edge Computing Benefit From Software-Defined Networking: A Survey, Use Cases, and Future DirectionsIEEE Communications Surveys & Tutorials, 2017
- EdgeCloudSim: An environment for performance evaluation of Edge Computing systems2017
- Efficient Multi-User Computation Offloading for Mobile-Edge Cloud ComputingIEEE/ACM Transactions on Networking, 2015
- Human-level control through deep reinforcement learningNature, 2015
- The Case for VM-Based Cloudlets in Mobile ComputingIEEE Pervasive Computing, 2009