An Overview on Mixing MPI and OpenMP Dependent Tasking on A64FX
Open Access
- 11 January 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 7-16
Abstract
The adoption of ARM processor architectures is on the rise in the HPC ecosystem. Fugaku supercomputer is a homogeneous ARM-based machine, and is one among the most powerful machine in the world. In the programming world, dependent task-based programming models are gaining tractions due to their many advantages: dynamic load balancing, implicit expression of communication/computation overlap, early-bird communication posting,...MPI and OpenMP are two widespreads programming standards that make possible task-based programming at a distributed memory level. Despite its many advantages, mixed-use of the standard programming models using dependent tasks is still under-evaluated on large-scale machines. In this paper, we provide an overview on mixing OpenMP dependent tasking model with MPI with the state-of-the-art software stack (GCC-13, Clang17, MPC-OMP). We provide the level of performances to expect by porting applications to such mixed-use of the standard on the Fugaku supercomputers, using two benchmarks (Cholesky, HPCCG) and a proxy-application (LULESH). We show that software stack, resource binding and communication progression mechanisms are factors that have a significant impact on performance. On distributed applications, performances reaches up to 80% of effiency for task-based applications like HPCCG. We also point-out a few areas of improvements in OpenMP runtimes.Keywords
This publication has 18 references indexed in Scilit:
- MPI Detach - Asynchronous Local Completion2020
- The Supercomputer “Fugaku” and Arm-SVE enabled A64FX processor for energy-efficiency and sustained application performance2020
- Integrating blocking and non-blocking MPI primitives with task-based programming modelsParallel Computing, 2019
- Finepoints: Partitioned Multithreaded MPI Communication2019
- Supercomputing with commodity CPUs2013
- LULESH 2.0 Updates and Changes2013
- StarPU: a unified platform for task scheduling on heterogeneous multicore architecturesConcurrency and Computation: Practice and Experience, 2010
- Enabling Low-Overhead Hybrid MPI/OpenMP Parallelism with MPC2010
- Effective performance measurement and analysis of multithreaded applicationsACM SIGPLAN Notices, 2009
- MPC: A Unified Parallel Runtime for Clusters of NUMA Machines2008