Cur-CoEdge: Curiosity-Driven Collaborative Request Scheduling in Edge-Cloud Systems
Authors:
- 20 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 411-420
Abstract
The collaboration between clouds and edges unlocks the full potential of edge-cloud systems. Edge-cloud platform has brought about significant decentralization, heterogeneity, complexity, and instability. These characteristics have posed unprecedented challenges to the optimal scheduling problem in the edge-cloud system, including inaccurate decision-making and slow convergence. In this paper, we propose a curiosity-driven collaborative request scheduling scheme in edge-cloud systems, namely Cur-CoEdge. To tackle the challenge of inaccurate decision-making, we introduce a time-scale and decision-level interaction mechanism. This mechanism employs a small-large-time-scale scheduling learning framework, facilitating mutual learning between different decision levels. To address the challenge of slow convergence, we investigate the underlying reasons, such as the sparse reward-setting in reinforcement learning. In response, we develop a curiosity-driven collaborative exploration approach that fosters intrinsic curiosity in the cloud and simultaneously motivates dispatchers to explore the environment both individually and collectively. The effectiveness of this collaborative exploration is also supported by theoretical proof of convergence. Finally, we implement a prototype system on a network hardware system along with two real-world traces. Evaluations demonstrate significant improvements, with up to a 26% increase in time efficiency, a 40% rise in system throughput, and a 71% enhancement in convergence speed.Keywords
Funding Information
- National Science Foundation
This publication has 27 references indexed in Scilit:
- TapFinger: Task Placement and Fine-Grained Resource Allocation for Edge Machine Learning2023
- EdgeMatrix: A Resources Redefined Edge-Cloud System for Prioritized Services2022
- EdgeTuner: Fast Scheduling Algorithm Tuning for Dynamic Edge-Cloud Workloads and Resources2022
- Unified curiosity-Driven learning with smoothed intrinsic reward estimationPattern Recognition, 2021
- Layer Aware Microservice Placement and Request Scheduling at the Edge2021
- Tailored Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud System2021
- Service Placement and Request Scheduling for Data-intensive Applications in Edge Clouds2019
- Joint Service Placement and Request Routing in Multi-cell Mobile Edge Computing Networks2019
- A new class of fuzzy contractive mappings and fixed point theoremsFuzzy Sets and Systems, 2018
- Curiosity-Driven Exploration by Self-Supervised Prediction2017