Cross-Edge Orchestration of Serverless Functions With Probabilistic Caching
- 10 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. 17 (5) , 2139-2150
Abstract
Serverless edge computing adopts an event-based paradigm that provides back-end services and dynamically provisions resources as needed, resulting in efficient resource utilization. To improve the end-to-end latency and revenue, service providers need to optimize the number and placement of serverless containers while considering the system cost (i.e., latency cost and container running cost) incurred by the provisioning. The particular reason for this circumstance is that frequently creating and destroying containers not only increases the system cost but also degrades the time responsiveness due to the cold-start process. Function caching is a common approach to mitigate the coldstart issue. However, function caching requires extra hardware resources and hence incurs extra system costs. Furthermore, the dynamic and bursty nature of serverless invocations remains an under-explored area. Hence, it is vitally important for service providers to conduct a context-aware request distribution and container caching policy for serverless edge computing. In this paper, we study the request distribution and container caching problem in serverless edge computing. We prove the proposed problem is NP-hard and hence difficult to find a global optimal solution. We jointly consider the distributed and resourceconstrained nature of edge computing and propose an optimized request distribution algorithm that adapts to the dynamics of serverless invocations with a theoretical performance guarantee. Also, we propose a context-aware probabilistic caching policy that incorporates a number of characteristics of serverless invocations. Via simulation and implementation results, we demonstrate the superiority of the proposed algorithm by outperforming existing caching policies in terms of the overall system cost and cold-start frequency by up to 62.1% and 69.1%, respectively.Keywords
This publication has 42 references indexed in Scilit:
- SpecFaaS: Accelerating Serverless Applications with Speculative Function Execution2023
- Energy-Aware Resource Scheduling for Serverless Edge Computing2022
- Defuse: A Dependency-Guided Function Scheduler to Mitigate Cold Starts on FaaS Platforms2021
- Reliability-aware Dynamic Service Chain Scheduling in 5G Networks based on Reinforcement Learning2021
- Optimized container scheduling for data-intensive serverless edge computingFuture Generation Computer Systems, 2021
- Service Placement with Provable Guarantees in Heterogeneous Edge Computing Systems2019
- Joint Service Placement and Request Routing in Multi-cell Mobile Edge Computing Networks2019
- Optimal Edge User Allocation in Edge Computing with Variable Sized Vector Bin Packing2018
- An Optimal Auction Mechanism for Mobile Edge Caching2018
- A genetic algorithm for the generalised assignment problemComputers & Operations Research, 1997