Towards an Efficient Use of the BLAS Library for Multilinear Tensor Contractions
Authors:
- Edoardo Di NapoliENEdoardo Di Napoli
- Diego Fabregat-TraverDFDiego Fabregat-Traver
- Gregorio Quintana-OrtìGQGregorio Quintana-Ortì
- Paolo BientinesiPBPaolo Bientinesi
Preprint
Abstract
Mathematical operators whose transformation rules constitute the building blocks of a multi-linear algebra are widely used in physics and engineering applications where they are very often represented as tensors. In the last century, thanks to the advances in tensor calculus, it was possible to uncover new research fields and make remarkable progress in the existing ones, from electromagnetism to the dynamics of fluids and from the mechanics of rigid bodies to quantum mechanics of many atoms. By now, the formal mathematical and geometrical properties of tensors are well defined and understood; conversely, in the context of scientific and high-performance computing, many tensor- related problems are still open. In this paper, we address the problem of efficiently computing contractions among two tensors of arbitrary dimension by using kernels from the highly optimized BLAS library. In particular, we establish precise conditions to determine if and when GEMM, the kernel for matrix products, can be used. Such conditions take into consideration both the nature of the operation and the storage scheme of the tensors, and induce a classification of the contractions into three groups. For each group, we provide a recipe to guide the users towards the most effective use of BLAS.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Local Convergence of the Alternating Least Squares Algorithm for Canonical Tensor ApproximationSIAM Journal on Matrix Analysis and Applications, 2012
- TT-cross approximation for multidimensional arraysLinear Algebra and its Applications, 2010
- Anatomy of high-performance matrix multiplicationACM Transactions on Mathematical Software, 2008
- Numerical relativity: a reviewClassical and Quantum Gravity, 2001
- A set of level 3 basic linear algebra subprogramsACM Transactions on Mathematical Software, 1990
- An extended set of FORTRAN basic linear algebra subprogramsACM Transactions on Mathematical Software, 1988
- Issues relating to extension of the Basic Linear Algebra SubprogramsACM SIGNUM Newsletter, 1985
- Basic Linear Algebra Subprograms for Fortran UsageACM Transactions on Mathematical Software, 1979