Non-collective parallel I/O for global address space programming models
Authors:
- 1 January 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15525244,p. 41-49
Abstract
Achieving high performance for out-of-core applications typically involves explicit management of the movement of data between the disk and the physical memory. We are developing a programming environment in which the different levels of the memory hierarchy are handled efficiently in a unified transparent framework. In this paper, we present our experiences with implementing efficient non-collective I/O (GPCIO) as part of this framework. As a generalization of the remote procedure call (RPC) that was used as a foundation for the Sun NFS system, we developed a global procedure call (GPC) to invoke procedures on a remote node to handle non-collective I/O. We consider alternative approaches that can be employed in implementing this functionality. The approaches are evaluated using a representative computation from quantum chemistry. The results demonstrate that GPC-IO achieves better absolute execution times, strong-scaling, and weak-scaling than the alternatives considered.Keywords
This publication has 12 references indexed in Scilit:
- Hypergraph Partitioning for Automatic Memory Hierarchy Management2006
- TAO users manual.2003
- Shared memory mirroring for reducing communication overhead on commodity networks2003
- Disk resident arrays: an array-oriented I/O library for out-of-core computations2002
- Distant I/O: one-sided access to secondary storage on remote processors2002
- Performance and experience with LAPI-a new high-performance communication library for the IBM RS/6000 SP2002
- ChemIo: High Performance Parallel I/o for Computational Chemistry ApplicationsThe International Journal of High Performance Computing Applications, 1998
- Global arrays: A nonuniform memory access programming model for high-performance computersThe Journal of Supercomputing, 1996
- Shared memory NUMA programming on I-WAY1996
- A high-level framework for network-based resource sharing1976