Erms: Efficient Resource Management for Shared Microservices with SLA Guarantees
Authors:
Open Access
- 19 December 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 62-77
Abstract
A common approach to improving resource utilization in data centers is to adaptively provision resources based on the actual workload. One fundamental challenge of doing this in microservice management frameworks, however, is that different components of a service can exhibit significant differences in their impact on end-to-end performance. To make resource management more challenging, a single microservice can be shared by multiple online services that have diverse workload patterns and SLA requirements. We present an efficient resource management system, namely Erms, for guaranteeing SLAs in shared microservice environments. Erms profiles microservice latency as a piece-wise linear function of the workload, resource usage, and interference. Based on this profiling, Erms builds resource scaling models to optimally determine latency targets for microservices with complex dependencies. Erms also designs new scheduling policies at shared microservices to further enhance resource efficiency. Experiments across microservice benchmarks as well as trace-driven simulations demonstrate that Erms can reduce SLA violation probability by 5× and more importantly, lead to a reduction in resource usage by 1.6×, compared to state-of-the-art approaches.Keywords
This publication has 28 references indexed in Scilit:
- An Open-Source Benchmark Suite for Microservices and Their Hardware-Software Implications for Cloud & Edge Systems2019
- GrandSLAm2019
- The Elasticity and Plasticity in Semi-Containerized Co-locating Cloud Workload2018
- Overload Control for Scaling WeChat Microservices2018
- Distributed resource management across process boundaries2017
- XGBoost2016
- Heracles2015
- iBench: Quantifying interference for datacenter applications2013
- Paragon2013
- Convex Optimization2004