Vienna-Fortran/HPF extensions for sparse and irregular problems and their compilation
Authors:
- 1 January 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 8 (10) , 1068-1083
Abstract
Vienna Fortran, High Performance Fortran (HPF), and other data parallel languages have been introduced to allow the programming of massively parallel distributed-memory machines (DMMP) at a relatively high level of abstraction, based on the SPMD paradigm. Their main features include directives to express the distribution of data and computations across the processors of a machine. In this paper, we use Vienna-Fortran as a general framework for dealing with sparse data structures. We describe new methods for the representation and distribution of such data on DMMPs, and propose simple language features that permit the user to characterize a matrix as "sparse" and specify the associated representation. Together with the data distribution for the matrix, this enables the compiler and runtime system to translate sequential sparse code into explicitly parallel message-passing code. We develop new compilation and runtime techniques, which focus on achieving storage economy and reducing communication overhead in the target program. The overall result is a powerful mechanism for dealing efficiently with sparse matrices in data parallel languages and their compilers for DMMPs.Keywords
This publication has 16 references indexed in Scilit:
- Automatic data structure selection and transformation for sparse matrix computationsIEEE Transactions on Parallel and Distributed Systems, 1996
- Sparse Block and Cyclic Data Distributions for Matrix Computations1995
- Numerical experiences with partitioning of unstructured meshesParallel Computing, 1994
- Massively parallel methods for engineering and science problemsCommunications of the ACM, 1994
- Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods1994
- Extending HPF for Advanced Data-Parallel ApplicationsIEEE Parallel & Distributed Technology: Systems & Applications, 1994
- User defined mappings in Vienna FortranACM SIGPLAN Notices, 1993
- The scheduling of sparse matrix-vector multiplication on a massively parallel DAP computerParallel Computing, 1992
- Programming in Vienna FortranScientific Programming, 1992
- A Partitioning Strategy for Nonuniform Problems on MultiprocessorsIEEE Transactions on Computers, 1987