Improving the Performance of the Sparse Matrix Vector Product with GPUs
Authors:
- F. VázquezFVF. Vázquez
- G. OrtegaGOG. Ortega
- J.J. FernándezJFJ.J. Fernández
- E.M. GarzónEGE.M. Garzón
- 1 June 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1146-1151
Abstract
Sparse matrices are involved in linear systems, eigensystems and partial differential equations from a wide spectrum of scientific and engineering disciplines. Hence, sparse matrix vector product (SpMV) is considered as key operation in engineering and scientific computing. For these applications the optimization of the sparse matrix vector product (SpMV) is very relevant. However, the irregular computation involved in SpMV prevents the optimum exploitation of computational architectures when the sparse matrices are very large. Graphics Processing Units (GPUs) have recently emerged as platforms that yield outstanding acceleration factors. SpMV implementations for GPUs have already appeared on the scene. This work proposes and evaluates new implementations of SpMV for GPUs called ELLR-T. They are based on the format ELLPACK-R, which allows storage of the sparse matrix in a regular manner. A comparative evaluation against a variety of storage formats previously proposed has been carried out based on a representative set of test matrices. The results show that: (1) the SpMV is highly accelerated with GPUs; (2) the performance strongly depends on the specific pattern of the matrix; and (3) the implementations ELLR-T achieve higher overall performance. Consequently, the new implementations of SpMV, ELLR-T, described in this paper can help to exploit the GPUs, because, they achieve high performance and they can be easily joined in the engineering and scientific computing.Keywords
This publication has 7 references indexed in Scilit:
- A matrix approach to tomographic reconstruction and its implementation on GPUsJournal of Structural Biology, 2010
- Implementing sparse matrix-vector multiplication on throughput-oriented processors2009
- Concurrent number cruncher: a GPU implementation of a general sparse linear solverInternational Journal of Parallel, Emergent and Distributed Systems, 2009
- Optimization of sparse matrix–vector multiplication on emerging multicore platformsParallel Computing, 2009
- Optimizing matrix multiplication for a short-vector SIMD architecture – CELL processorParallel Computing, 2009
- Improving the memory-system performance of sparse-matrix vector multiplicationIBM Journal of Research and Development, 1997
- Sparse Matrix Computations on Parallel Processor ArraysSIAM Journal on Scientific Computing, 1993