I/O requirements of scientific applications: an evolutionary view
Authors:
- 1 January 1996
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10828907,p. 49-59
Abstract
The modest I/O configurations and file system limitations of many current high-performance systems preclude solution of problems with large I/O needs. I/O hardware and file system parallelism is the key to achieving high performance. We analyze the I/O behavior of several versions of two scientific applications on the Intel Paragon XP/S. The versions involve incremental application code enhancements across multiple releases of the operating system. Studying the evolution of I/O access patterns underscores the interplay between application access patterns and file system features. Our results show that both small and large request sizes are common, that at present, application developers must manually aggregate small requests to obtain high disk transfer rates, that concurrent file accesses are frequent, and that appropriate matching of the application access pattern and the file system access mode can significantly increase application I/O performance. Based on these results, we describe a set of file system design principles.Keywords
This publication has 6 references indexed in Scilit:
- Unstructured Spectral Element Methods for Simulation of Turbulent FlowsJournal of Computational Physics, 1995
- PPFS1995
- Parallel computation of electron molecule collisionsIEEE Computational Science and Engineering, 1995
- RAID: high-performance, reliable secondary storageACM Computing Surveys, 1994
- A static analysis of I/O characteristics of scientific applications in a production workload1993
- Input/output behavior of supercomputing applications1991