A Scalable RISC-V Vector Processor Enabling Efficient Multi-Precision DNN Inference
Authors:
- 19 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
RISC-V processors encounter substantial challenges in deploying multi-precision deep neural networks (DNNs) due to their restricted precision support, constrained throughput, and suboptimal dataflow design. To tackle these challenges, a scalable RISC-V vector (RVV) processor, namely SPEED, is proposed to enable efficient multi-precision DNN inference by innovations from customized instructions, hardware architecture, and dataflow mapping. Firstly, dedicated customized RISC-V instructions are proposed based on RVV extensions, providing SPEED with fine-grained control over processing precision ranging from 4 to 16 bits. Secondly, a parameterized multi-precision systolic array unit is incorporated within the scalable module to enhance parallel processing capability and data reuse opportunities. Finally, a mixed multi-precision dataflow strategy, compatible with different convolution kernels and data precision, is proposed to effectively improve data utilization and computational efficiency. We perform synthesis of SPEED in TSMC 28nm technology. The experimental results demonstrate that SPEED achieves a peak throughput of 287.41 GOPS and an energy efficiency of 1335.79 GOPS/W at 4-bit precision condition, respectively. Moreover, when compared to the pioneer open-source vector processor Ara, SPEED provides an area efficiency improvement of 2.04× and 1.63× under 16-bit and 8-bit precision conditions, respectively, which shows SPEED’s significant potential for efficient multi-precision DNN inference.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China
- Nanjing University
This publication has 20 references indexed in Scilit:
- A Precision-Scalable RISC-V DNN Processor with On-Device Learning Capability at the Extreme Edge2024
- Bebert: Efficient And Robust Binary Ensemble Bert2023
- Quark: An Integer RISC-V Vector Processor for Sub-Byte Quantized DNN Inference2023
- A “New Ara” for Vector Computing: An Open Source Highly Efficient RISC-V V 1.0 Vector Processor Design2022
- Accelerating 3D Convolutional Neural Networks Using 3D Fast Fourier Transform2021
- Explicit Loss-Error-Aware Quantization for Low-Bit Deep Neural Networks2018
- Quantized deep neural networks for energy efficient hardware-based inference2018
- Deep Residual Learning for Image Recognition2016
- Very deep convolutional neural network based image classification using small training sample size2015
- Going deeper with convolutions2015