COSMOS: Coordinated Management of Cores, Memory, and Compressed Memory Swap for QoS-Aware and Efficient Workload Consolidation for Memory-Intensive Applications
Open Access
- 24 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 133199-133214
Abstract
With the rapid growth in memory demands, the slowdown of DRAM scaling, and the DRAM price fluctuations, DRAM has become one of the critical resources in cloud computing systems and datacenters. The compressed memory swap (CMS) is a promising technique that improves the effective memory capacity of the underlying computer system by compressing and storing a subset of pages in memory instead of the disk swap. While prior works have extensively investigated resource management techniques for workload consolidation, they lack the capability of dynamically allocating cores, memory, andCMSto the consolidated applications in a controlled and efficient manner. To bridge this gap, this work presents the in-depth characterization of the impact of cores, memory, and CMS on the QoS and throughput of the consolidated latency-critical (LC) and batch applications. Guided by the characterization results, we propose COSMOS, a software-based runtime system for coordinated management of cores, memory, and CMS for QoS-aware and efficient workload consolidation for memory-intensive applications. COSMOS dynamically collects the runtime data from the consolidated applications and the underlying system and allocates the resources to the consolidated applications in a way that achieves high throughput with strong QoS guarantees. Our quantitative evaluation based on a real system and widely-used memory-intensive benchmarks demonstrates the effectiveness of COSMOS in that it robustly satisfies the QoS and achieves high throughput across all the evaluatedworkload mixes and scenarios and significantly reduces the number of explored system states.Keywords
Funding Information
- Samsung Advanced Institute of Technology, Samsung Electronics Company Ltd.
- National Research Foundation of Korea (NRF-2021R1A2C1011482)
- Institute of Information & Communications Technology Planning & Evaluation (2021-0-01817)
This publication has 30 references indexed in Scilit:
- Tailbench: a benchmark suite and evaluation methodology for latency-critical applications2016
- Dirigent2016
- Heracles2015
- Towards energy proportionality for large-scale latency-critical workloads2014
- Speedy transactions in multicore in-memory databases2013
- Bubble-flux2013
- Thread reinforcer: Dynamically determining number of threads via OS level monitoring2011
- Fifty Years of Moore's LawIEEE Transactions on Semiconductor Manufacturing, 2011
- Feedback-driven threading2008
- Improving system performance with compressed memory2002