DIANA: An End-to-End Hybrid DIgital and ANAlog Neural Network SoC for the Edge
Top Cited Papers
- 31 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 58 (1) , 203-215
Abstract
DIgital-ANAlog (DIANA), a heterogeneous multi-core accelerator, combines a reduced instruction set computer -five (RISC-V) host processor with an analog in-memory computing (AIMC) artificial intelligence (AI) accelerator and a digital reconfigurable deep neural network (DNN) accelerator in a single system-on-chip (SoC) to support a wide variety of neural network (NN) workloads. AIMC cores can bring extreme computational parallelism and efficiency at the expense of accuracy and dataflow flexibility. Digital AI co-processors, on the other hand, guarantee accuracy through deterministic compute, but cannot achieve the same computational density and efficiency. DIANA exploits this fundamental tradeoff by integrating both types of cores in a shared and optimized memory system, to enable seamless execution of the workloads on the parallel cores. The system’s performance benefits further from pipelined parallel execution across both accelerator cores and enhanced AIMC spatial unrolling techniques, leading to drastically reduced execution latency and reduced memory footprints. The design has been implemented in a 22-nm technology and achieves peak efficiencies of 600 TOP/s/W for the AIMC core (I/W/O: 7/1.5/6 bit) and 14 TOP/s/W (I/W/O: 8/8/8 bit) for the digital accelerator, respectively. End-to-end performance evaluation of CIFAR-10 and ImageNet classification workloads is carried out on the chip, reporting 7.02 and 5.56 TOP/s/W, respectively, at the system level.Keywords
Funding Information
- KU Leuven
- European Union (EU) European Research Council (ERC) for Resource-efficient sensing through dynamic attention-scalability (Re-SENSE) Project (ERC-2016-STG-715037)
- Flemish Government (Artificial intelligence
This publication has 29 references indexed in Scilit:
- An Always-On 3.8 $\mu$ J/86% CIFAR-10 Mixed-Signal Binary CNN Processor With All Memory on Chip in 28-nm CMOSIEEE Journal of Solid-State Circuits, 2018
- Mixed-precision in-memory computingNature Electronics, 2018
- NeuroSim+: An integrated device-to-algorithm framework for benchmarking synaptic devices and array architectures2017
- Embedded Deep Neural Network Processing: Algorithmic and Processor Techniques Bring Deep Learning to IoT and Edge DevicesIEEE Solid-State Circuits Magazine, 2017
- 14.5 Envision: A 0.26-to-10TOPS/W subword-parallel dynamic-voltage-accuracy-frequency-scalable Convolutional Neural Network processor in 28nm FDSOI2017
- Fused-layer CNN accelerators2016
- ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars2016
- 14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks2016
- Microsoft COCO: Common Objects in Context2014
- A fully-synthesizable single-cycle interconnection network for Shared-L1 processor clusters2011