A fast GEMM implementation on the cypress GPU
Author:
Open Access
- 29 March 2011
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGMETRICS Performance Evaluation Review
- Vol. 38 (4) , 50-55
Abstract
We present benchmark results of optimized dense matrix multiplication kernels for Cypress GPU. We write general matrix multiply (GEMM) kernels for single (SP), double (DP) and double-double (DDP) precision. Our SGEMM and DGEMM kernels show ~ 2 Top/s and ~ 470 Glop/s, respectively. These results for SP and DP correspond to 73% and 87% of the theoretical performance of the GPU, respectively. Currently, our SGEMM and DGEMM kernels are fastest with one GPU chip to our knowledge. Furthermore, the performance of our matrix multiply kernel in DDP is 31 Gop/s. This performance in DDP is more than 200 times faster than the performance results in DDP on single core of a recent CPU (with mpack version 0.6.5). We describe our GEMM kernels with main focus on the SGEMM implementation since all GEMM kernels share common programming and optimization techniques. While a conventional wisdom of GPU programming recommends us to heavily use shared memory on GPUs, we show that texture cache is very effective on the Cypress architecture.Keywords
This publication has 7 references indexed in Scilit:
- Application of Many-core Accelerators for Problems in Astronomy and Physics2011
- A Note on Auto-tuning GEMM for GPUs2009
- A compiler for high performance computing with many-core accelerators2009
- Anatomy of high-performance matrix multiplicationACM Transactions on Mathematical Software, 2008
- Understanding the efficiency of GPU algorithms for matrix-matrix multiplication2004
- Algorithms for quad-double precision floating point arithmetic2002
- A floating-point technique for extending the available precisionNumerische Mathematik, 1971