Xfast: Extreme File Attribute Stat Acceleration for Lustre
Open Access
- 11 November 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Abstract
Directory tree walks on parallel file systems are costly operations frequently required by many storage management tasks. Even listing the contents of a single directory can take minutes to hours for huge directories, as the tree walk performance of parallel file systems in Linux is severely throttled by sequentially accessing distributed metadata for each file through the syscall interface. We present eXtreme file attribute stat (Xfast), which scales the performance of directory tree walks by combining techniques that have been developed over a time frame of 10 years for the Lustre file system. Scalable statahead predicts file access patterns and prefetches required attributes, while the Size on MDT (SOM) mechanism reduces the number of RPC calls to collect file attributes. Xfast improves the performance of common directory operations, e.g. reduces the time to list one million files from 11 minutes to less than one minute for a single process.Keywords
Funding Information
- National Natural Science Foundation of China (U22A6001)
- National Key R&D Program of China (2022YFB4500405)
- Zhejiang Provincial Ten Thousand Talents Program (2021R52007)
- Science and Technology Innovation 2030-Major Project (2021ZD0114300)
- Joint Research Project of Zhejiang Lab (K2022DA0AM01)
- European Union?s Horizon 2020 and the German Ministry of Education and Research (BMBF) (956748-ADMIRE-H2020-JTI-EuroHPC-2019-1)
This publication has 14 references indexed in Scilit:
- Efficient Directory Mutations in a Full-Path-Indexed File SystemACM Transactions on Storage, 2018
- APS: adaptable prefetching scheme to different running environments for concurrent read streams in distributed file systemsThe Journal of Supercomputing, 2018
- A configurable rule based classful token bucket filter network request scheduler for the lustre file system2017
- Diving into petascale production file systems through large scale profiling and analysis2017
- vNFSACM Transactions on Storage, 2017
- The Effect of Flashcache and Bcache on I/O PerformanceJournal of Physics: Conference Series, 2014
- An Asynchronous Striping-Aware Readahead Framework for Disk Arrays in LinuxIEICE Transactions on Information and Systems, 2013
- On the design of a new Linux readahead frameworkACM SIGOPS Operating Systems Review, 2008
- A Design for File Access in a Mobile Environment1994
- Depth-First Search and Linear Graph AlgorithmsSIAM Journal on Computing, 1972