Optimizing point‐to‐point communication between adaptive MPI endpoints in shared memory
Authors:
- 12 March 2018
- journal article
- conference paper
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 32 (3)
Abstract
Summary: Adaptive MPI is an implementation of the MPI standard that supports the virtualization of ranks as user‐level threads, rather than OS processes. In this work, we optimize the communication performance of AMPI based on the locality of the endpoints communicating within a cluster of SMP nodes. We differentiate between point‐to‐point messages with both endpoints co‐located on the same execution unit and point‐to‐point messages with both endpoints residing in the same process but not on the same execution unit. We demonstrate how the messaging semantics of Charm++ enable and hinder AMPI's implementation in different ways, and we motivate extensions to Charm++ to address the limitations. Using the OSU micro‐benchmark suite, we show that our locality‐aware design offers lower latency, higher bandwidth, and reduced memory footprint for applications.Keywords
Funding Information
- National Nuclear Security Administration (DE‐NA0002374)
This publication has 21 references indexed in Scilit:
- Parallel Programming with Migratable Objects: Charm++ in Practice2014
- Enabling communication concurrency through flexible MPI endpointsThe International Journal of High Performance Computing Applications, 2014
- Eliminating Costs for Crossing Process Boundary from MPI Intra-node Communication2014
- Benefits of Cross Memory Attach for MPI libraries on HPC Clusters2014
- McMPI2013
- MPI + MPI: a new hybrid approach to parallel programming with MPI plus shared memoryComputing, 2013
- Leveraging MPI’s One-Sided Communication Interface for Shared-Memory ProgrammingLecture Notes in Computer Science, 2012
- MPC-MPI: An MPI Implementation Reducing the Overall Memory Consumption2009
- MPC: A Unified Parallel Runtime for Clusters of NUMA Machines2008
- Performance evaluation of adaptive MPI2006