Optimizing Collective Communication in UPC
Authors:
- Jithin JoseJJJithin Jose
- Khaled HamidoucheKHKhaled Hamidouche
- Jie ZhangJZJie Zhang
- Akshay VenkateshAVAkshay Venkatesh
- Dhabaleswar K. PandaDPDhabaleswar K. Panda
- 1 May 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 63, 361-370
Abstract
Message Passing Interface (MPI) has been the defacto programming model for scientific parallel applications. However, data driven applications with irregular communication patterns are harder to implement using MPI. The Partitioned Global Address Space (PGAS) programming models present an alternative approach to improve programmability. PGAS languages like UPC are growing in popularity because of their ability to provide shared-memory programming model over distributed memory machines. However, since UPC is an emerging standard, it is unlikely that entire applications will be re-written with it. Instead, unified communication runtimes have paved the way for a new class of hybrid applications that can leverage the benefits of both MPI and PGAS models. Such unified runtimes need to be designed in a high performance, scalable manner to improve the performance of emerging hybrid applications. Collective communication primitives offer a flexible, portable way to implement group communication operations and are supported in both MPI and PGAS programming models. Owing to their advantages, they are also widely used across various scientific parallel applications. Over the years, MPI libraries have relied upon aggressive software- /hardware-based and kernel-assisted optimizations to deliver low communication latency for various collective operations. However, there is much room for improvement for collective operations in state-of-the-art, open-source implementations of UPC. In this paper, we address the challenges associated with improving the performance of collective primitives in UPC. Further, we also explore design alternatives to enable collective primitives in UPC to directly leverage the designs available in the MVAPICH2 MPI library. Our experimental evaluations show that our designs improve the performance of the UPC broadcast and all-gather operations, by 25X and 18X respectively for 128KB message at 2,048 processes. Our designs improve the performance of the UPC 2D-Heat kernel by up to 2X times at 2,048 processes, and NAS-FT benchmark by 12% at 256 processes.Keywords
This publication has 18 references indexed in Scilit:
- Tuning collective communication for Partitioned Global Address Space programming modelsParallel Computing, 2011
- Design and Evaluation of Network Topology-/Speed- Aware Broadcast Algorithms for InfiniBand Clusters2011
- The International Exascale Software Project roadmapThe International Journal of High Performance Computing Applications, 2011
- Unifying UPC and MPI runtimes2010
- A Programming Model Performance Study Using the NAS Parallel BenchmarksScientific Programming, 2010
- Understanding ultrascale application communication requirements2006
- Optimization of MPI collective communication on BlueGene/L systems2005
- Benchmark Measurements of Current UPC Platforms2005
- Communication characteristics of large-scale scientific applications for contemporary cluster architecturesJournal of Parallel and Distributed Computing, 2003
- UPC Performance and Potential: A NPB Experimental Study2002