ENTS: An Edge-native Task Scheduling System for Collaborative Edge Computing
- 1 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 149-161
Abstract
Collaborative edge computing (CEC) is an emerging paradigm enabling sharing of the coupled data, computation, and networking resources among heterogeneous geo-distributed edge nodes. Recently, there has been a trend to orchestrate and schedule containerized application workloads in CEC, while Kubernetes has become the de-facto standard broadly adopted by the industry and academia. However, Kubernetes is not preferable for CEC because its design is not dedicated to edge computing and neglects the unique features of edge nativeness. More specifically, Kubernetes primarily ensures resource provision of workloads while neglecting the performance requirements of edge-native applications, such as throughput and latency. Furthermore, Kubernetes neglects the inner dependencies of edge-native applications and fails to consider data locality and networking resources, leading to inferior performance. In this work, we design and develop ENTS, the first edge-native task scheduling system, to manage the distributed edge resources and facilitate efficient task scheduling to optimize the performance of edge-native applications. ENTS extends Kubernetes with the unique ability to collaboratively schedule computation and networking resources by comprehensively considering job profile and resource status. We showcase the superior efficacy of ENTS with a case study on data streaming applications. We mathematically formulate a joint task allocation and flow scheduling problem that maximizes the job throughput. We design two novel online scheduling algorithms to optimally decide the task allocation, bandwidth allocation, and flow routing policies. The extensive experiments on a real-world edge video analytics application show that ENTS achieves 43% -220% higher average job throughput compared with the state-of-the-art.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- Towards efficient edge cloud augmentation for virtual reality MMOGs2017
- A Survey on Mobile Edge Computing: The Communication PerspectiveIEEE Communications Surveys & Tutorials, 2017
- Predicting Workflow Task Execution Time in the Cloud Using A Two-Stage Machine Learning ApproachIEEE Transactions on Cloud Computing, 2017
- How Can Edge Computing Benefit From Software-Defined Networking: A Survey, Use Cases, and Future DirectionsIEEE Communications Surveys & Tutorials, 2017
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Borg, Omega, and KubernetesCommunications of the ACM, 2016
- Kubernetes and the path to cloud native2015
- RTT measurement and its dependence on the real geographical distance2011
- Convex Optimization2004
- Advances in dataflow programming languagesACM Computing Surveys, 2004