Stencil Computation with Vector Outer Product
Preprint
Abstract
Matrix computation units have been equipped in current architectures to accelerate AI and high performance computing applications. The matrix multiplication and vector outer product are two basic instruction types. The latter one is lighter since the inputs are vectors. Thus it provides more opportunities to develop flexible algorithms for problems other than dense linear algebra computing and more possibilities to optimize the implementation. Stencil computations represent a common class of nested loops in scientific and engineering applications. This paper proposes a novel stencil algorithm using vector outer products. Unlike previous work, the new algorithm arises from the stencil definition in the scatter mode and is initially expressed with formulas of vector outer products. The implementation incorporates a set of optimizations to improve the memory reference pattern, execution pipeline and data reuse by considering various algorithmic options and the data sharing between input vectors. Evaluation on a simulator shows that our design achieves a substantial speedup compared with vectorized stencil algorithm.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Vector Folding: Improving Stencil Performance via Multi-dimensional SIMD-vector Representation2015
- Cache Accurate Time Skewing in Iterative Stencil Computations2011
- Landing Stencil Code on Godson-TJournal of Computer Science and Technology, 2010
- Implementing the Himeno benchmark with CUDA on GPU clusters2010
- Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures2008
- Using time skewing to eliminate idle time due to memory bandwidth and network limitations2002
- Achieving Scalable Locality with Time SkewingInternational Journal of Parallel Programming, 2002
- Efficient tiling for an ODE discrete integration program: redundant tasks instead of trapezoidal shaped-tiles2002
- A Vectorizing Compiler for Multimedia ExtensionsInternational Journal of Parallel Programming, 2000
- Tiling Optimizations for 3D Scientific Computations2000