SMIV: A 16-nm 25-mm² SoC for IoT With Arm Cortex-A53, eFPGA, and Coherent Accelerators
- 11 October 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 57 (2) , 639-650
Abstract
Emerging Internet of Things (IoT) devices necessitate system-on-chips (SoCs) that can scale from ultralow power always-on (AON) operation, all the way up to less frequent high-performance tasks at high energy efficiency. Specialized accelerators are essential to help meet these needs at both ends of the scale, but maintaining workload flexibility remains an important goal. This article presents a 25-mm 2 SoC in 16-nm FinFET technology which demonstrates targeted, flexible acceleration of key compute-intensive kernels spanning machine learning (ML), DSP, and cryptography. The SMIV SoC includes a dedicated AON sub-system, a dual-core Arm Cortex-A53 CPU cluster, an SoC-attached embedded field-programmable gate array (eFPGA) array, and a quad-core cache-coherent accelerator (CCA) cluster. Measurement results demonstrate: 1) 1236 $\times $ power envelope, from 1.1 mW (only AON cluster), up to 1.36 W (whole SoC at maximum throughput); 2) 5.5–28.9 $\times $ energy efficiency gain from offloading compute kernels from A53 to eFPGA; 3) 2.94 $\times $ latency improvement using coherent memory access (CCA cluster); and 4) 55 $\times $ MobileNetV1 energy per inference improvement on CCA compared to the CPU baseline. The overall flexibility-efficiency range on SMIV spans measured energy efficiencies of 1 $\times $ (dual-core A53), 3.1 $\times $ (A53 with SIMD), 16.5 $\times $ (eFPGA), 54.9 $\times $ (CCA), and 256 $\times $ (AON) at a peak efficiency of 4.8 TOPS/W.
Keywords
This publication has 41 references indexed in Scilit:
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- Transition-Aware Human Activity Recognition Using SmartphonesNeurocomputing, 2016
- A 640M pixel/s 3.65mW sparse event-driven neuromorphic object recognition processor with on-chip learning2015
- A Multi-Granularity FPGA With Hierarchical Interconnects for Efficient and Flexible Mobile ComputingIEEE Journal of Solid-State Circuits, 2014
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- The Opportunity challenge: A benchmark database for on-body sensor-based activity recognitionPattern Recognition Letters, 2013
- Energy and performance exploration of accelerator coherency port using Xilinx ZYNQ2013
- Computer Generation of Hardware for Linear Digital Signal Processing TransformsACM Transactions on Design Automation of Electronic Systems, 2012
- The DARPA 1000-word resource management database for continuous speech recognition2003
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998