Lightweight and Holistic-Scalable Serverless Secure Container Runtime for High-Density Deployment and High-Concurrency Startup
- 21 May 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 74 (8) , 2621-2634
Abstract
The secure container that hosts a single container in a micro virtual machine (VM) is now used in serverless computing, as the containers are isolated through the microVMs. There are high demands on the high-density container deployment and high-concurrency container startup to improve both the resource utilization and user experience, as user functions are fine-grained in serverless platforms. Our investigation shows that the entire software stacks, containing the cgroups in the host operating system, the guest operating system, and the container rootfs for the function workload, together result in low deployment density and slow startup performance at high-concurrency. We propose a lightweight and holistic-scalable secure container runtime, named RunD-V, to resolve above problems in serverless computing. RunD-V proposes a guest-to-host runtime template for microVM scaling-out, and CR-bind feature in guest kernel for microVM scaling-up. Using guest-to-host runtime template, over 200 secure containers can be launched within 1s on a node equipped with 104 vCPUs. It also enables more than 2,500 secure containers to be deployed on a node with 384GB of memory. The vertical scaling mechanism CR-bind further enhances both startup concurrency and deployment density.Keywords
Funding Information
- National Natural Science Foundation of China (62232011, 62302302, 61832006)
This publication has 23 references indexed in Scilit:
- Microless: Cost-Efficient Hybrid Deployment of Microservices on IaaS VMs and Serverless2023
- Alita: Comprehensive Performance Isolation through Bias Resource Management for Public Clouds2020
- Adaptive Function Launching Acceleration in Serverless Computing Platforms2019
- FunctionBench: A Suite of Workloads for Serverless Cloud Function Service2019
- Evaluating Docker storage performance: from workloads to graph driversCluster Computing, 2019
- In Search of the Ideal Storage Configuration for Docker Containers2017
- Serverless Computing: Design, Implementation, and Performance2017
- Securing the infrastructure and the workloads of linux containers2015
- virtioACM SIGOPS Operating Systems Review, 2008
- Exokernel1995