Optimizing bandwidth limited problems using one-sided communication and overlap
Authors:
- 1 January 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 10 pp.-84
Abstract
This paper demonstrates the one-sided communication used in languages like UPC can provide a significant performance advantage for bandwidth-limited applications. This is shown through communication microbenchmarks and a case-study of UPC and MPI implementations of the NAS FT benchmark. Our optimizations rely on aggressively overlapping communication with computation, alleviating bottlenecks that typically occur when communication is isolated in a single phase. The new algorithms send more and smaller messages, yet the one-sided versions achieve > 1.9times speedup over the base Fortran/MPI. Our one-sided versions show an average 15% improvement over the two-sided versions, due to the lower software overhead of onesided communication, whose semantics are fundamentally lighter-weight than message passing. Our UPC results use Berkeley UPC with GASNet and demonstrate the scalability of that system, with performance approaching 0.5 TFlop/s on the FT benchmark with 512 processorsKeywords
This publication has 18 references indexed in Scilit:
- Titanium Performance and Potential: An NPB Experimental Study2006
- Transformations to Parallel Codes for Communication-Computation Overlap2005
- Automatic generation and tuning of MPI collective communication routines2005
- Scientific Computations on Modern Parallel Vector Systems2005
- Productivity analysis of the UPC language2004
- Parallel FFT on ATM-based networks of workstations2002
- Scalable parallel FFT for spectral simulations on a Beowulf clusterParallel Computing, 2001
- A comparison of optimal FFTs on torus and hypercube multicomputersParallel Computing, 2001
- A method for exploiting communication/computation overlap in hypercubesParallel Computing, 1998
- Comparison of two-dimensional FFT methods on the hypercube1988