Dynamic Management of Constrained Computing Resources for Serverless Services
Open Access
- 13 November 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 22 (2) , 1646-1663
Abstract
In resource-constrained cloud systems, e.g., at the network edge or in private clouds, serverless computing is increasingly adopted to deploy microservices-based applications, leveraging its promised high resource efficiency. Provisioning resources to serverless services, however, poses several challenges, due to the high cold-start latency of containers and stringent Service Level Agreement (SLA) requirements of the microservices. In response, we investigate the behavior of containers in different states (i.e., running, warm, or cold) and exploit our experimental observations to formulate an optimization problem that minimizes the energy consumption of the active servers while reducing SLA violations. In light of the problem complexity, we propose a low-complexity algorithm, named AiW, which utilizes a multi-queueing approach to balance energy consumption and system performance by reusing containers effectively and invoking cold-starts only when necessary. To further minimize the energy consumption of data centers, we introduce the two-timescale COmputing resource Management at the Edge (COME) framework, comprising an orchestrator running our proposed AiW algorithm for container provisioning and Dynamic Server Provisioner (DSP) for dynamically activating/deactivating servers in response to AiW’s decisions on request scheduling. COME addresses the mismatch in timescales for resource provisioning decisions at the container and server levels. Extensive performance evaluation through simulation shows AiW’s close match to the optimum and COME’s significant reduction in power consumption by 22–64% compared state-of-the-art alternatives.Keywords
Funding Information
- EC through the SEMANTIC project (861165)
- DFG through the SWAVES project
This publication has 18 references indexed in Scilit:
- Energy-aware Provisioning of Microservices for Serverless Edge Computing2023
- Workflow Scheduling in Serverless Edge Computing for the Industrial Internet of Things: A Learning ApproachIEEE Transactions on Industrial Informatics, 2022
- Retention-Aware Container Caching for Serverless Edge Computing2022
- Deadline-aware Dynamic Resource Management in Serverless Computing Environments2021
- Performance Modeling of Serverless Computing PlatformsIEEE Transactions on Cloud Computing, 2020
- A Survey of Virtual Machine Management in Edge ComputingProceedings of the IEEE, 2019
- Minimal Cost Server Configuration for Meeting Time-Varying Resource Demands in Cloud CentersIEEE Transactions on Parallel and Distributed Systems, 2018
- On the Energy-Proportionality of Data Center NetworksIEEE Transactions on Sustainable Computing, 2017
- Serverless Computing: Design, Implementation, and Performance2017
- Vector bin packing with multiple-choiceDiscrete Applied Mathematics, 2012