Towards Dynamic Scripted pNFS Layouts
Authors:
- Matthias GrawinkelMGMatthias Grawinkel
- Tim SüßTSTim Süß
- Gregor BestGBGregor Best
- Ivan PopovIPIvan Popov
- André BrinkmannABAndré Brinkmann
- 1 November 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 13-17
Abstract
Today's network file systems consist of a variety of complex subprotocols and backend storage classes. The data is typically spread over multiple data servers to achieve higher levels of performance and reliability. A metadata server is responsible for creating the mapping of a file to these data servers. It is hard to map application specific access patterns to storage system specific features, which can result in a degraded IO performance. We present an NFSv4.1/pNFS protocol extension that integrates the client's ability to provide hints and I/O advices to metadata servers. We define multiple storage classes and allow the client to choose which type of storage fits best for its desired access pattern. Furthermore, we propose flexible, script based file layouts that describe a logical file's mapping to its storage locations by an interpreted script instead of a fixed mapping. We discuss the possibilities of such an extension, show that it integrates well with the pNFS protocol and show that the latency and compute overhead of interpreted layouts justifies the gained features.Keywords
This publication has 8 references indexed in Scilit:
- Reliable and randomized data distribution strategies for large scale storage systems2011
- A microdriver architecture for error correcting codes inside the Linux kernel2009
- The evolution of Lua2007
- Dynamic and Redundant Data Placement2007
- Large files, small writes, and pNFS2006
- A fast algorithm for online placement and reorganization of replicated data2004
- Clusterfile: a flexible physical layout parallel file system2001
- The HP AutoRAID hierarchical storage system1995