Ownership passing
Authors:
Open Access
- 23 February 2013
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGPLAN Notices
- Vol. 48 (8) , 177-186
Abstract
The number of cores in multi- and many-core high-performance processors is steadily increasing. MPI, the de-facto standard for programming high-performance computing systems offers a distributed memory programming model. MPI's semantics force a copy from one process' send buffer to another process' receive buffer. This makes it difficult to achieve the same performance on modern hardware than shared memory programs which are arguably harder to maintain and debug. We propose generalizing MPI's communication model to include ownership passing, which make it possible to fully leverage the shared memory hardware of multi- and many-core CPUs to stream communicated data concurrently with the receiver's computations on it. The benefits and simplicity of message passing are retained by extending MPI with calls to send (pass) ownership of memory regions, instead of their contents, between processes. Ownership passing is achieved with a hybrid MPI implementation that runs MPI processes as threads and is mostly transparent to the user. We propose an API and a static analysis technique to transform legacy MPI codes automatically and transparently to the programmer, demonstrating that this scheme is easy to use in practice. Using the ownership passing technique, we see up to 51% communication speedups over a standard message passing implementation on state-of-the art multicore systems. Our analysis and interface will lay the groundwork for future development of MPI-aware optimizing compilers and multi-core specific optimizations, which will be key for success in current and next-generation computing platforms.Keywords
This publication has 9 references indexed in Scilit:
- Inferring ownership transfer for efficient message passing2011
- Communication-Sensitive Static Dataflow for Parallel Message Passing Applications2009
- Hybrid MPI/OpenMP Parallel Programming on Clusters of Multi-Core SMP Nodes2009
- MPC-MPI: An MPI Implementation Reducing the Overall Memory Consumption2009
- The Problem with ThreadsComputer, 2006
- Generic programming for high performance scientific applications2002
- Optimizing threaded MPI execution on SMP clusters2001
- ROSE: COMPILER SUPPORT FOR OBJECT-ORIENTED FRAMEWORKSParallel Processing Letters, 2000
- The performance of message‐passing using restricted virtual memory remappingSoftware: Practice and Experience, 1991