Shuhai: Benchmarking High Bandwidth Memory On FPGAS
Authors:
- 1 May 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 111-119
Abstract
FPGAs are starting to be enhanced with High Bandwidth Memory (HBM) as a way to reduce the memory bandwidth bottleneck encountered in some applications and to give the FPGA more capacity to deal with application state. However, the performance characteristics of HBM are still not well specified, especially in the context of FPGAs. In this paper, we bridge the gap between nominal specifications and actual performance by benchmarking HBM on a state-of-the-art FPGA, i.e., a Xilinx Alveo U280 featuring a two-stack HBM subsystem. To this end, we propose Shuhai, a benchmarking tool that allows us to demystify all the underlying details of HBM on an FPGA. FPGA-based benchmarking should also provide a more accurate picture of HBM than doing so on CPUs/GPUs, since CPUs/GPUs are noisier systems due to their complex control logic and cache hierarchy. Since the memory itself is complex, leveraging custom hardware logic to benchmark inside an FPGA provides more details as well as accurate and deterministic measurements. We observe that 1) HBM is able to provide up to 425 GB/s memory bandwidth, and 2) how HBM is used has a significant impact on performance, which in turn demonstrates the importance of unveiling the performance characteristics of HBM so as to select the best approach. Shuhai can be easily generalized to other FPGA boards or other generations of memory, e.g., HBM3, and DDR3. We will make Shuhai open-source, benefiting the community.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- A quantitative analysis on microarchitectures of modern CPU-FPGA platforms2016
- A performance analysis framework for optimizing OpenCL applications on FPGAs2016
- A Study of Pointer-Chasing Performance on Shared-Memory Processor-FPGA Systems2016
- A Case for Work-stealing on FPGAs with OpenCL Atomics2016
- Design optimization of high bandwidth memory (HBM) interposer considering signal integrity2015
- A transport-layer network for distributed FPGA platforms2015
- A study of data partitioning on OpenCL-based FPGAs2015
- A High Memory Bandwidth FPGA Accelerator for Sparse Matrix-Vector Multiplication2014
- A Model for Programming Data-Intensive Applications on FPGAs: A Genomics Case Study2012
- Efficient synthesis of compressor trees on FPGAs2008