Intelligent Task Dispatching and Scheduling Using a Deep Q-Network in a Cluster Edge Computing System
Open Access
Abstract
Recently, intelligent IoT applications based on artificial intelligence (AI) have been deployed with mobile edge computing (MEC). Intelligent IoT applications demand more computing resources and lower service latencies for AI tasks in dynamic MEC environments. Thus, in this paper, considering the resource scalability and resource optimization of edge computing, an intelligent task dispatching model using a deep Q-network, which can efficiently use the computing resource of edge nodes is proposed to maximize the computation ability of the cluster edge system, which consists of multiple edge nodes. The cluster edge system can be implemented with the Kubernetes technology. The objective of the proposed model is to minimize the average response time of tasks offloaded to the edge computing system and optimize the resource allocation for computing the offloaded tasks. For this, we first formulate the optimization problem of resource allocation as a Markov decision process (MDP) and adopt a deep reinforcement learning technology to solve this problem. Thus, the proposed intelligent task dispatching model is designed based on a deep Q-network (DQN) algorithm to update the task dispatching policy. The simulation results show that the proposed model archives a better convergence performanc in terms of the average completion time of all offloaded tasks, than existing task dispatching methods, such as the Random Method, Least Load Method and Round-Robin Method, and has a better task completion rate than the existing task dispatching method when using the same resources as the cluster edge system.Keywords
Funding Information
- Institute for Information and Communications Technology Planning and Evaluation (IITP) through the Korean Government [Ministry of Science and ICT (MSIT)] (2020-0-00116, NRF-2020R1I1A3065610)
- Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2020-0-00116, NRF-2020R1I1A3065610)
This publication has 23 references indexed in Scilit:
- Joint Cotask-Aware Offloading and Scheduling in Mobile Edge Computing SystemsIEEE Access, 2019
- Computation Offloading in Multi-Access Edge Computing Networks: A Multi-Task Learning Approach2019
- iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT NetworksIEEE Internet of Things Journal, 2019
- Fog Computing: Survey of Trends, Architectures, Requirements, and Research DirectionsIEEE Access, 2018
- A Survey on the Edge Computing for the Internet of ThingsIEEE Access, 2017
- Mobile Edge Computing: A SurveyIEEE Internet of Things Journal, 2017
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and ApplicationsIEEE Internet of Things Journal, 2017
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Computation Offloading for Service Workflow in Mobile Cloud ComputingIEEE Transactions on Parallel and Distributed Systems, 2014