SlimCache
Authors:
Open Access
- 31 May 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 16 (2) , 1-34
Abstract
Flash-based key-value caching is becoming popular in data centers for providing high-speed key-value services. These systems adopt slab-based space management on flash and provide a low-cost solution for key-value caching. However, optimizing cache efficiency for flash-based key-value cache systems is highly challenging, due to the huge number of key-value items and the unique technical constraints of flash devices. In this article, we present a dynamic on-line compression scheme, called SlimCache , to improve the cache hit ratio by virtually expanding the usable cache space through data compression. We have investigated the effect of compression granularity to achieve a balance between compression ratio and speed, and we leveraged the unique workload characteristics in key-value systems to efficiently identify and separate hot and cold data. To dynamically adapt to workload changes during runtime, we have designed an adaptive hot/cold area partitioning method based on a cost model. To avoid unnecessary compression, SlimCache also estimates data compressibility to determine whether the data are suitable for compression or not. We have implemented a prototype based on Twitter’s Fatcache. Our experimental results show that SlimCache can accommodate more key-value items in flash by up to 223.4%, effectively increasing throughput and reducing average latency by up to 380.1% and 80.7%, respectively.Keywords
Funding Information
- Research Grants Council of Hong Kong (GRF 15273616, GRF 15206617, GRF 15224918)
- Chinese University of Hong Kong (Direct Grant for Research (Project No. 4055096))
- National Science Foundation (1453705, 1629291, 1910958)
- Louisiana Board of Regents (LEQSF(2014-17)-RD-A-01)
This publication has 30 references indexed in Scilit:
- Architecting to achieve a billion requests per second throughput on a single key-value store server platform2015
- DRACO: A Deduplicating FTL for Tangible Extra CapacityIEEE Computer Architecture Letters, 2014
- Memory partitioning in Memcached: An experimental performance analysis2014
- Cache craftiness for fast multicore key-value storage2012
- SILT2011
- Dynamic tracking of page miss ratio curve for memory management2004
- Adaptive compressed caching: design and implementation2004
- Hardware compressed main memory: operating system support and performance evaluationIEEE Transactions on Computers, 2001
- Data compression on a database systemCommunications of the ACM, 1985
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948