Implementing MPI-IO atomic mode without file system support
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1135
Abstract
The ROMIO implementation of the MPI-IO standard provides a portable infrastructure for use on top of any number of different underlying storage targets. These different targets vary widely in their capabilities, and in some cases, additional effort is needed within ROMIO to support the complete MPI-IO semantics. One aspect of the interface that can be problematic to implement is the MPI-IO atomic mode. This mode requires enforcing strict consistency semantics. For some file systems, native locks may be used to enforce these semantics, but not all file systems have lock support. In this work, we describe two algorithms for implementing efficient mutex locks using MPI-1 and MPI-2 capabilities. We then show how these algorithms may be used to implement a portable MPI-IO atomic mode for ROMIO. We evaluate the performance of these algorithms and show that they impose little additional overhead on the system. Because of the low-overhead nature of these algorithms, they are likely useful in a variety of situations where distributed locks are needed in the MPI-2 environment.Keywords
This publication has 6 references indexed in Scilit:
- Minimizing Synchronization Overhead in the Implementation of MPI One-Sided CommunicationLecture Notes in Computer Science, 2004
- Data management and transfer in high-performance computational grid environmentsParallel Computing, 2002
- On implementing MPI-IO portably and with high performance1999
- Using MPI-21999
- A Case for Using MPI's Derived Datatypes to Improve I/O Performance1998
- Algorithms for scalable synchronization on shared-memory multiprocessorsACM Transactions on Computer Systems, 1991