FOSS: Learning-Based Multi-Level Design Makes FIFO More Adaptive for CDN Caching
- 3 November 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 37 (1) , 155-168
Abstract
With the rapid growth of data-intensive applications, such as artificial intelligence and the Internet of Things, CDNs, which use persistent storage (e.g., SSDs and HDDs) to cache data at the edge, have become crucial for enhancing network efficiency. Two metrics—hit ratio and processing latency—are essential for evaluating CDN caching performance. However, CDN caching faces the challenge of write amplification, creating a trade-off between random access for higher hit ratios and sequential writes for reducing processing latency. Existing cache designs struggle to effectively balance these conflicting requirements across diverse workloads. In this paper, we present FOSS, a caching system specifically optimized for CDNs deployed on SSD-based storage and hybrid SSD–HDD storage, which features a streamlined, thin file system that operates independently of the kernel. At its heart, FOSS employs a multi-level FIFO queue to strike a balance between local sequential and global random access on SSDs. Then, FOSS incorporates a learning-based method to dynamically configure the multi-level structure configuration, making the system adaptive to various workload characteristics and caching algorithm requirements. Therefore, FOSS ensures better performance across different scenarios. Our extensive experiments show FOSS improves hit ratios significantly over existing systems, reduces end-to-end response latency by 16.5% and demonstrates a consistent performance improvement in various settings on large-scale commercial CDN traces.Keywords
Funding Information
- National Natural Science Foundation of China (62132009)
- Fundamental Research Funds for the Central Universities at China
This publication has 33 references indexed in Scilit:
- LearnedFTL: A Learning-Based Page-Level FTL for Reducing Double Reads in Flash-Based SSDs2024
- Learning-based Data Separation for Write Amplification Reduction in Solid State Drives2023
- SlimCache: Exploiting Data Compression Opportunities in Flash-Based Key-Value Caching2018
- Garbage collection and wear leveling for flash memory: Past and future2014
- Rethinking Flash in the Data CenterIEEE Micro, 2010
- Content Delivery Networks2008
- Globally distributed content deliveryIEEE Internet Computing, 2002
- LRFU: a spectrum of policies that subsumes the least recently used and least frequently used policiesIEEE Transactions on Computers, 2001
- LRU Is Better than FIFOAlgorithmica, 1999
- Caching strategies to improve disk system performanceComputer, 1994