Siyao Lai
Research Subjects
Research Interests
Siyao Lai has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Andreas Dilger
Whamcloud/DDN
1 shared publication - André Brinkmann
Saarland University, Saarbrücken, Germany
1 shared publication - Lingfang Zeng
Zhejiang Laboratory, Hangzhou, China
1 shared publication - Marc-André Vef
Johannes Gutenberg University Mainz, Mainz, Germany
1 shared publication - Shuichi Ihara
Data Direct Networks, Tokoy, Japan
1 shared publication - Wen Cheng
Zhejiang Lab
1 shared publication
Latest Publications
- Open Access
- 11 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Xfast: Extreme File Attribute Stat Acceleration for Lustre
Directory tree walks on parallel file systems are costly operations frequently required by many storage management tasks. Even listing the contents of a single directory can take minutes to hours for huge directories, as the tree walk performance of parallel file systems in Linux is severely throttled by sequentially accessing distributed metadata for each file through the syscall interface. We present eXtreme file attribute stat (Xfast), which scales the performance of directory tree walks by combining techniques that have been developed over a time frame of 10 years for the Lustre file system. Scalable statahead predicts file access patterns and prefetches required attributes, while the Size on MDT (SOM) mechanism reduces the number of RPC calls to collect file attributes. Xfast improves the performance of common directory operations, e.g. reduces the time to list one million files from 11 minutes to less than one minute for a single process.
- 11 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessXfast: Extreme File Attribute Stat Acceleration for Lustre
Directory tree walks on parallel file systems are costly operations frequently required by many storage management tasks. Even listing the contents of a single directory can take minutes to hours for huge directories, as the tree walk performance of parallel file systems in Linux is severely throttled by sequentially accessing distributed metadata for each file through the syscall interface. We present eXtreme file attribute stat (Xfast), which scales the performance of directory tree walks by combining techniques that have been developed over a time frame of 10 years for the Lustre file system. Scalable statahead predicts file access patterns and prefetches required attributes, while the Size on MDT (SOM) mechanism reduces the number of RPC calls to collect file attributes. Xfast improves the performance of common directory operations, e.g. reduces the time to list one million files from 11 minutes to less than one minute for a single process.