A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter
Authors:
Top Cited Papers
Open Access
- 16 August 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Storage
- Vol. 17 (3) , 1-35
Abstract
Modern web services use in-memory caching extensively to increase throughput and reduce latency. There have been several workload analyses of production systems that have fueled research in improving the effectiveness of in-memory caching systems. However, the coverage is still sparse considering the wide spectrum of industrial cache use cases. In this work, we significantly further the understanding of real-world cache workloads by collecting production traces from 153 in-memory cache clusters at Twitter, sifting through over 80 TB of data, and sometimes interpreting the workloads in the context of the business logic behind them. We perform a comprehensive analysis to characterize cache workloads based on traffic pattern, time-to-live (TTL), popularity distribution, and size distribution. A fine-grained view of different workloads uncover the diversity of use cases: many are far more write-heavy or more skewed than previously shown and some display unique temporal patterns. We also observe that TTL is an important and sometimes defining parameter of cache working sets. Our simulations show that ideal replacement strategy in production caches can be surprising, for example, FIFO works the best for a large number of workloads.Keywords
Funding Information
- NSF (CNS 1901410 and CNS 1956271)
This publication has 43 references indexed in Scilit:
- Workload analysis of a large-scale key-value storeACM SIGMETRICS Performance Evaluation Review, 2012
- LRFU: a spectrum of policies that subsumes the least recently used and least frequently used policiesIEEE Transactions on Computers, 2001
- A workload characterization study of the 1998 World Cup Web siteIEEE Network, 2000
- File system usage in Windows NT 4.0ACM SIGOPS Operating Systems Review, 1999
- Workload characterization of a Web proxy in a cable modem environmentACM SIGMETRICS Performance Evaluation Review, 1999
- Internet Web servers: workload characterization and performance implicationsIEEE/ACM Transactions on Networking, 1997
- Analysis of caching algorithms for distributed file systemsACM SIGOPS Operating Systems Review, 1996
- The LRU-K page replacement algorithm for database disk bufferingACM SIGMOD Record, 1993
- Measurements of a distributed file systemACM SIGOPS Operating Systems Review, 1991
- Data cache management using frequency-based replacementACM SIGMETRICS Performance Evaluation Review, 1990