TTC: a tensor transposition compiler for multiple architectures
Authors:
Open Access
- 2 June 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 41-46
Abstract
We consider the problem of transposing tensors of arbitrary dimension and describe TTC, an open source domain-specific parallel compiler. TTC generates optimized parallel C++/CUDA C code that achieves a significant fraction of the system's peak memory bandwidth. TTC exhibits high performance across multiple architectures, including modern AVX-based systems (e.g.,~Intel Haswell, AMD Steamroller), Intel's Knights Corner as well as different CUDA-based GPUs such as NVIDIA's Kepler and Maxwell architectures. We report speedups of TTC over a meaningful baseline implementation generated by external C++ compilers; the results suggest that a domain-specific compiler can outperform its general purpose counterpart significantly: For instance, comparing with Intel's latest C++ compiler on the Haswell and Knights Corner architecture, TTC yields speedups of up to $8\times$ and $32\times$, respectively. We also showcase TTC's support for multiple leading dimensions, making it a suitable candidate for the generation of performance-critical packing functions that are at the core of the ubiquitous BLAS 3 routines
Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- BLIS: A Framework for Rapidly Instantiating BLAS FunctionalityACM Transactions on Mathematical Software, 2015
- Efficient 3D Transpositions in Graphics Processing UnitsInternational Journal of Parallel Programming, 2015
- An efficient tensor transpose algorithm for multicore CPU, Intel Xeon Phi, and NVidia Tesla GPUComputer Physics Communications, 2015
- Optimizing matrix transposes using a POWER7 cache model and explicit prefetchingACM SIGMETRICS Performance Evaluation Review, 2012
- P3DFFT: A Framework for Parallel Computations of Fourier Transforms in Three DimensionsSIAM Journal on Scientific Computing, 2012
- Coupled-cluster theory in quantum chemistryReviews of Modern Physics, 2007
- Iterative Compilation2002
- Design and performance of a scalable parallel community climate modelParallel Computing, 1995
- Automatic benchmark generation for cache optimization of matrix operations1995
- A fast algorithm for transposing large multidimensional image data setsUltramicroscopy, 1991