Data Partitioning on Multicore and Multi-GPU Platforms Using Functional Performance Models
- 4 December 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 64 (9) , 2506-2518
Abstract
Heterogeneous multiprocessor systems, which are composed of a mix of processing elements, such as commodity multicore processors, graphics processing units (GPUs), and others, have been widely used in scientific computing community. Software applications incorporate the code designed and optimized for different types of processing elements in order to exploit the computing power of such heterogeneous computing systems. In this paper, we consider the problem of optimal distribution of the workload of data-parallel scientific applications between processing elements of such heterogeneous computing systems. We present a solution that uses functional performance models (FPMs) of processing elements and FPM-based data partitioning algorithms. Efficiency of this approach is demonstrated by experiments with parallel matrix multiplication and numerical simulation of lid-driven cavity flow on hybrid servers and clusters.Keywords
Funding Information
- SFI (08/IN.1/I2054)
- NSFC (61403402)
This publication has 15 references indexed in Scilit:
- DYNAMIC LOAD BALANCING OF PARALLEL COMPUTATIONAL ITERATIVE ROUTINES ON HIGHLY HETEROGENEOUS HPC PLATFORMSParallel Processing Letters, 2011
- Automatic tuning of iterative computation on heterogeneous multiprocessors with ADITHEThe Journal of Supercomputing, 2009
- RooflineCommunications of the ACM, 2009
- Solving dense linear systems on platforms with multiple hardware acceleratorsACM SIGPLAN Notices, 2009
- MergeACM SIGPLAN Notices, 2008
- Data Partitioning with a Functional Performance Model of Heterogeneous ProcessorsThe International Journal of High Performance Computing Applications, 2007
- A Fast and High Quality Multilevel Scheme for Partitioning Irregular GraphsSIAM Journal on Scientific Computing, 1998
- Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear SystemsSIAM Journal on Scientific and Statistical Computing, 1992
- Solution of the implicitly discretised fluid flow equations by operator-splittingJournal of Computational Physics, 1986
- High-Re solutions for incompressible flow using the Navier-Stokes equations and a multigrid methodJournal of Computational Physics, 1982