On the design of a new Linux readahead framework
Authors:
Open Access
- 1 July 2008
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM SIGOPS Operating Systems Review
- Vol. 42 (5) , 75-84
Abstract
As Linux runs an increasing variety of workloads, its in-kernel readahead algorithm has been challenged by many unexpected and subtle problems. To name a few: readahead thrashings arise when readahead pages are evicted prematurely under memory pressure; readahead attempts on already cached pages are undesirable; interrupted-then-retried reads and locally disordered NFS reads that can easily fool the sequential detection logic. In this paper, we present a new Linux readahead framework with flexible and robust heuristics that can cover varied sequential I/O patterns. It also enjoys great simplicity by handling most abnormal cases in an implicit way. We demonstrate its advantages by a host of case studies. Network throughput is 3 times better in the case of thrashing and 1.8 times better for large NFS files. On serving large files with lighttpd, the disk utilization is decreased by 26% while providing 17% more network throughput.Keywords
Funding Information
- Intel Corporation (4507345522)
- Ministry of Science and Technology of the People's Republic of China (2006AA01Z114)
- National Natural Science Foundation of China (60774038)
This publication has 14 references indexed in Scilit:
- Optimal multistream sequential prefetching in a shared cacheACM Transactions on Storage, 2007
- Caching and prefetching algorithms for programs with looping reference patternsThe Computer Journal, 2005
- The performance impact of kernel prefetching on buffer cache replacement algorithmsACM SIGMETRICS Performance Evaluation Review, 2005
- Mining block correlations to improve storage performanceACM Transactions on Storage, 2005
- Compiler-based I/O prefetching for out-of-core applicationsACM Transactions on Computer Systems, 2001
- Implementation and performance of integrated application-controlled file caching, prefetching, and disk schedulingACM Transactions on Computer Systems, 1996
- Informed prefetching and caching1995
- A status report on research in transparent informed prefetchingACM SIGOPS Operating Systems Review, 1993
- A fast file system for UNIXACM Transactions on Computer Systems, 1984
- The Multics Input/Output system1971