Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasing
Authors:
- Francesco ContiFCFrancesco Conti
- Gianna PaulinGPGianna Paulin
- Davide RossiDRDavide Rossi
- Alfio Di MauroAMAlfio Di Mauro
- Georg RutishauserGRGeorg Rutishauser
- Gianmarco OttaviGOGianmarco Ottavi
- Manuel EggimannMEManuel Eggimann
- Hayate OkuharaHOHayate Okuhara
- Luca BeniniLBLuca Benini
Preprint
Abstract
Emerging Artificial Intelligence-enabled Internet-of-Things (AI-IoT) System-on-a-Chip (SoC) for augmented reality, personalized healthcare, and nano-robotics need to run many diverse tasks within a power envelope of a few tens of mW over a wide range of operating conditions: compute-intensive but strongly quantized Deep Neural Network (DNN) inference, as well as signal processing and control requiring high-precision floating-point. We present Marsellus, an all-digital heterogeneous SoC for AI-IoT end-nodes fabricated in GlobalFoundries 22nm FDX that combines 1) a general-purpose cluster of 16 RISC-V Digital Signal Processing (DSP) cores attuned for the execution of a diverse range of workloads exploiting 4-bit and 2-bit arithmetic extensions (XpulpNN), combined with fused MAC&LOAD operations and floating-point support; 2) a 2-8bit Reconfigurable Binary Engine (RBE) to accelerate 3x3 and 1x1 (pointwise) convolutions in DNNs; 3) a set of On-Chip Monitoring (OCM) blocks connected to an Adaptive Body Biasing (ABB) generator and a hardware control loop, enabling on-the-fly adaptation of transistor threshold voltages. Marsellus achieves up to 180 Gop/s or 3.32 Top/s/W on 2-bit precision arithmetic in software, and up to 637 Gop/s or 12.4 Top/s/W on hardware-accelerated DNN layers.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- DIANA: An End-to-End Hybrid DIgital and ANAlog Neural Network SoC for the EdgeIEEE Journal of Solid-State Circuits, 2022
- SamurAI: A Versatile IoT Node With Event-Driven Wake-Up and Embedded ML AccelerationIEEE Journal of Solid-State Circuits, 2022
- Improving Autonomous Nano-Drones Performance via Automated End-to-End Optimization and Deployment of DNNsIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2021
- A 12.1 TOPS/W Quantized Network Acceleration Processor With Effective-Weight-Based Convolution and Error-Compensation-Based PredictionIEEE Journal of Solid-State Circuits, 2021
- Vega: A Ten-Core SoC for IoT Endnodes With DNN Acceleration and Cognitive Wake-Up From MRAM-Based State-Retentive Sleep ModeIEEE Journal of Solid-State Circuits, 2021
- A Low-Power Transprecision Floating-Point Cluster for Efficient Near-Sensor Data AnalyticsIEEE Transactions on Parallel and Distributed Systems, 2021
- DORY: Automatic End-to-End Deployment of Real-World DNNs on Low-Cost IoT MCUsIEEE Transactions on Computers, 2021
- SleepRunner: A 28-nm FDSOI ULP Cortex-M0 MCU With ULL SRAM and UFBR PVT Compensation for 2.6–3.6-μW/DMIPS 40–80-MHz Active Mode and 131-nW/kB Fully Retentive Deep-Sleep ModeIEEE Journal of Solid-State Circuits, 2021
- XNOR Neural Engine: A Hardware Accelerator IP for 21.6-fJ/op Binary Neural Network InferenceIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- A 60 GOPS/W, −1.8 V to 0.9 V body bias ULP cluster in 28 nm UTBB FD-SOI technologySolid-State Electronics, 2016