TierScape: Harnessing Multiple Compressed Tiers to Tame Server Memory TCO
Open Access
- 26 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 247-262
Abstract
Tiered memory systems are the norm to effectively tackle the increasing memory total cost of ownership (TCO) in modern data centers. We propose TierScape to tame memory TCO through the novel creation and judicious management of multiple compressed memory tiers along with multiple byte-addressable tiers. As opposed to conventional tiering solutions that employ a single compressed memory tier, we harness multiple compressed tiers implemented through a combination of different compression algorithms, memory allocators for compressed objects, and backing media to store compressed objects. These compressed tiers represent distinct points in the access latency, data compressibility, and unit memory usage cost spectrum, allowing rich and flexible trade-offs between memory TCO savings and application performance impact. A key advantage with TierScape is that it enables aggressive memory TCO saving opportunities by placing warm data in low latency compressed tiers with a reasonable performance impact while simultaneously placing cold data in the best memory TCO saving tiers. TierScape presents a comprehensive, rigorous, and tunable analytical cost model for performance and TCO trade-off based on continuous monitoring of the application's data access profile. Guided by this model, TierScape takes informed actions to dynamically manage the placement and migration of application data across multiple compressed and byte-addressable tiers. We believe TierScape represents an important server system configuration and optimization capability to achieve the best SLA-aware performance per dollar for applications hosted in production data center environments. For a set of real-world benchmarks, TierScape reduces memory TCO by 15.1–23.6% percentage points while maintaining performance parity or improves performance by 2.61–10.0% percentage points while maintaining memory TCO parity compared to state-of-the-art tiering solutions.Keywords
This publication has 22 references indexed in Scilit:
- Experimental lossless data compressorMicroprocessors and Microsystems, 2023
- Memory Pooling With CXLIEEE Micro, 2023
- Profiling Dynamic Data Access Patterns with Controlled Overhead and Quality2019
- Nimble Page Management for Tiered Memory Systems2019
- Software-Defined Far Memory in Warehouse-Scale Computers2019
- Thermostat2017
- HeteroVisor2015
- A Fast Implementation of Deflate2014
- Ligra2013
- Benchmarking cloud serving systems with YCSB2010