Effective implementation of the High Performance Conjugate Gradient benchmark on GraphBLAS
Preprint
Abstract
Applications in High-Performance Computing (HPC) environments face challenges due to increasing complexity. Among them, the increasing usage of sparse data pushes the limits of data structures and programming models and hampers the efficient usage of existing, highly parallel hardware. The GraphBLAS specification tackles these challenges by proposing a set of data containers and primitives, coupled with a semantics based on abstract algebraic concepts: this allows multiple applications on sparse data to be described with a small set of primitives and benefit from the many optimizations of a compile-time-known algebraic specification. Among HPC applications, the High Performance Conjugate Gradient (HPCG) benchmark is an important representative of a large body of sparse workloads, and its structure poses several programmability and performance challenges. This work tackles them by proposing and evaluating an implementation on GraphBLAS of HPCG, highlighting the main changes to its kernels. The results for shared memory systems outperforms the reference, while results in distributed systems highlight fundamental limitations of GraphBLAS-compliant implementations, which suggests several future directions.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Preparing sparse solvers for exascale computingPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2020
- Algorithm 1000ACM Transactions on Mathematical Software, 2019
- A new metric for ranking high-performance computing systemsNational Science Review, 2016
- High performance conjugate gradient solver on multi-GPU clusters using hypergraph partitioningComputer Science - Research and Development, 2010
- Component‐based iterative methods for sparse linear systemsConcurrency and Computation: Practice and Experience, 2006
- Heuristic methods for graph coloring problems2005
- The LINPACK Benchmark: past, present and futureConcurrency and Computation: Practice and Experience, 2003
- Iterative Methods for Sparse Linear Systems2003
- The effect of ordering on preconditioned conjugate gradientsBIT Numerical Mathematics, 1989
- Basic Linear Algebra Subprograms for Fortran UsageACM Transactions on Mathematical Software, 1979