DARKSIDE: A Heterogeneous RISC-V Compute Cluster for Extreme-Edge On-Chip DNN Inference and Training
Authors:
Preprint
Abstract
On-chip DNN inference and training at the Extreme-Edge (TinyML) impose strict latency, throughput, accuracy and flexibility requirements. Heterogeneous clusters are promising solutions to meet the challenge, combining the flexibility of DSP-enhanced cores with the performance and energy boost of dedicated accelerators. We present DARKSIDE, a System-on-Chip with a heterogeneous cluster of 8 RISC-V cores enhanced with 2-b to 32-b mixed-precision integer arithmetic. To boost performance and efficiency on key compute-intensive Deep Neural Network (DNN) kernels, the cluster is enriched with three digital accelerators: a specialized engine for low-data-reuse depthwise convolution kernels (up to 30 MAC/cycle); a minimal overhead datamover to marshal 1-b to 32-b data on-the-fly; a 16-b floating point Tensor Product Engine (TPE) for tiled matrix-multiplication acceleration. DARKSIDE is implemented in 65nm CMOS technology. The cluster achieves a peak integer performance of 65 GOPS and a peak efficiency of 835 GOPS/W when working on 2-b integer DNN kernels. When targeting floating-point tensor operations, the TPE provides up to 18.2 GFLOPS of performance or 300 GFLOPS/W of efficiency - enough to enable on-chip floating-point training at competitive speed coupled with ultra-low power quantized inference.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A Heterogeneous In-Memory Computing Cluster for Flexible End-to-End Inference of Real-World Deep Neural NetworksIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2022
- HERMES-Core—A 1.59-TOPS/mm 2 PCM on 14-nm CMOS In-Memory Compute Core Using 300-ps/LSB Linearized CCO-Based ADCsIEEE Journal of Solid-State Circuits, 2022
- A TinyML Platform for On-Device Continual Learning With Quantized Latent ReplaysIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2021
- Vega: A Ten-Core SoC for IoT Endnodes With DNN Acceleration and Cognitive Wake-Up From MRAM-Based State-Retentive Sleep ModeIEEE Journal of Solid-State Circuits, 2021
- GVSoC: A Highly Configurable, Fast and Accurate Full-Platform Simulator for RISC-V based IoT Processors2021
- DORY: Automatic End-to-End Deployment of Real-World DNNs on Low-Cost IoT MCUsIEEE Transactions on Computers, 2021
- SleepRunner: A 28-nm FDSOI ULP Cortex-M0 MCU With ULL SRAM and UFBR PVT Compensation for 2.6–3.6-μW/DMIPS 40–80-MHz Active Mode and 131-nW/kB Fully Retentive Deep-Sleep ModeIEEE Journal of Solid-State Circuits, 2021
- PULP-NN: accelerating quantized neural networks on parallel ultra-low-power RISC-V processorsPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2019
- A Lightweight and Discriminative Model for Remote Sensing Scene Classification With Multidilation Pooling ModuleIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019
- Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile DevicesIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2019