KaMPIng: Flexible and (Near) Zero-Overhead C++ Bindings for MPI
Authors:
- 17 November 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-21
Abstract
The Message-Passing Interface (MPI) and C++ form the backbone of high-performance computing, but MPI only provides $\mathbf{C}$ and Fortran bindings. While this offers great language interoperability, high-level programming languages like C++ make software development quicker and less error-prone.We propose novel $\mathrm{C}_{++}$language bindings that cover all abstraction levels from low-level MPI calls to convenient STL-style bindings, where most parameters are inferred from a small subset of parameters, by bringing named parameters to C++. This enables rapid prototyping and fine-tuning runtime behavior and memory management. A flexible type system and additional safety guarantees help to prevent programming errors.By exploiting C++’s template metaprogramming capabilities, this has (near) zero overhead, as only required code paths are generated at compile time.We demonstrate that our library is a strong foundation for a future distributed standard library using multiple application benchmarks, ranging from text-book sorting algorithms to phylogenetic interference.
Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Distributed Deep Multilevel Graph Partitioning2023
- Communication-free massively distributed graph generationJournal of Parallel and Distributed Computing, 2019
- RAxML-NG: a fast, scalable and user-friendly tool for maximum likelihood phylogenetic inferenceBioinformatics, 2019
- Sequential and Parallel Algorithms and Data Structures2019
- Fault Tolerance Techniques for High-Performance Computing2015
- Phase-Field Simulations of Large-Scale Microstructures by Integrated Parallel Algorithms2014
- RAxML version 8: a tool for phylogenetic analysis and post-analysis of large phylogeniesBioinformatics, 2014
- Exascale Computing Technology Challenges2011
- MPI for Python: Performance improvements and MPI-2 extensionsJournal of Parallel and Distributed Computing, 2008
- The evolution of large-scale structure in a universe dominated by cold dark matterThe Astrophysical Journal, 1985