A scalable sparse matrix-vector multiplication kernel for energy-efficient sparse-blas on FPGAs
Open Access
- 26 February 2014
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 161-170
Abstract
Sparse Matrix-Vector Multiplication (SpMxV) is a widely used mathematical operation in many high-performance scientific and engineering applications. In recent years, tuned software libraries for multi-core microprocessors (CPUs) and graphics processing units (GPUs) have become the status quo for computing SpMxV. However, the computational throughput of these libraries for sparse matrices tends to be significantly lower than that of dense matrices, mostly due to the fact that the compression formats required to efficiently store sparse matrices mismatches traditional computing architectures. This paper describes an FPGA-based SpMxV kernel that is scalable to efficiently utilize the available memory bandwidth and computing resources. Benchmarking on a Virtex-5 SX95T FPGA demonstrates an average computational efficiency of 91.85%. The kernel achieves a peak computational efficiency of 99.8%, a >50x improvement over two Intel Core i7 processors (i7-2600 and i7-4770) and showing a >300x improvement over two NVIDA GPUs (GTX 660 and GTX Titan), when running the MKL and cuSPARSE sparse-BLAS libraries, respectively. In addition, the SpMxV FPGA kernel is able to achieve higher performance than its CPU and GPU counterparts, while using only 64 single-precision processing elements, with an overall 38-50x improvement in energy efficiency.Keywords
This publication has 12 references indexed in Scilit:
- Towards a Universal FPGA Matrix-Vector Multiplication Architecture2012
- An I/O Bandwidth-Sensitive Sparse Matrix-Vector Multiplication Engine on FPGAsIEEE Transactions on Circuits and Systems I: Regular Papers, 2011
- Reconfigurable sparse/dense matrix-vector multiplier2009
- FPGA vs. GPU for sparse matrix vector multiply2009
- Implementing sparse matrix-vector multiplication on throughput-oriented processors2009
- Understanding the Performance of Sparse Matrix-Vector Multiplication2008
- Optimization of sparse matrix-vector multiplication on emerging multicore platforms2007
- FPGA Based Sparse Matrix Vector Multiplication using Commodity DRAM Memory2007
- Sparse Matrix-Vector Multiplication Design on FPGAs2007
- Sparse Matrix-Vector multiplication on FPGAs2005