Delphinus: Improving Resource Efficiency of Applications with Shared Microservices and Diverse Queries
Open Access
- 25 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 23 (2) , 1-26
Abstract
Microservices are widely shared in production user-facing applications. These shared microservices have various resource usage patterns when queries from different call graphs of different services access them. However, existing microservice management works fail to efficiently scale resources for them, mainly due to the lack of fine-grained scheduling of diverse queries. We therefore propose Delphinus , a runtime system that efficiently manages resources for shared microservices while ensuring the Quality-of-Service (QoS). Delphinus comprises a group-oriented query scheduler and a borrowing-based load adapter . The query scheduler identifies diverse queries, groups the containers of shared microservices, and schedules the queries into separate groups. The load adapter efficiently scales resources for shared microservices, and fully utilizes the idle containers among groups when the loads of diverse queries change. Results show that Delphinus reduces CPU and memory usage by 40.1% and 36.4% for shared microservices, respectively, compared to state-of-the-art works.Keywords
Funding Information
- National Natural Science Foundation of China (62232011, and U25B2021)
- Natural Science Foundation of Shanghai Municipality (25ZR1402241)
This publication has 22 references indexed in Scilit:
- Veyth: Adaptive Container Placement for Optimizing Cross-Server Network Traffic of Microservice Applications2025
- Adaptive QoS-Aware Microservice Deployment With Excessive Loads via Intra- and Inter-Datacenter SchedulingIEEE Transactions on Parallel and Distributed Systems, 2024
- An In-Depth Study of Microservice Call Graph and Runtime PerformanceIEEE Transactions on Parallel and Distributed Systems, 2022
- Rhythm2020
- ATOM: Model-Driven Autoscaling for Microservices2019
- Seer2019
- GrandSLAm2019
- Fault Analysis and Debugging of Microservice Systems: Industrial Survey, Benchmark System, and Empirical StudyIEEE Transactions on Software Engineering, 2018
- Proceedings of the ACMSE 2018 Conference2018
- Distributed resource management across process boundaries2017