A Precision-Scalable Accelerator with Sign-Magnitude Representation and Dual Adder Trees
Open Access
- 8 October 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 24 (6) , 1-26
Abstract
Currently, there are two mainstream acceleration methods; one is mixed precision and the other is sparsity. Few accelerators support both mixed precision and sparsity, and most enable precision configurations across layers rather than within a single layer. Furthermore, most of accelerators adopt the traditional two’s complement (2C) data representation method, and we found that 2C brings many invalid “1” when representing signed data, which brings more resources overhead for mixed precision and many invalid operations for bit-level sparsity. Therefore, we propose a high-efficiency accelerator featuring a precision-scalable Sign-Magnitude Processing Element (SM-PE), which adopts a data representation method of SM and can flexibly support various precision calculations (2, 4, 8 bits) and bit-level sparsity. In addition, a dynamic quantization algorithm named DoReFaLike and a bit-level column sparsity (BLCS) technique are proposed to improve the efficiency of SM-PEs. Under the same accuracy constraint, the sparsity rate of the SM scheme is 3.5× higher than that of the 2C format. The accelerator has been synthesized on a 55nm CMOS ASIC platform. When scaled to 28nm, experimental results show that the energy efficiency of the proposed accelerator reaches 15.50, 25.37, 101.54 TOPS/W with 8-bit, 4-bit, and 2-bit input activations, respectively, and weights represented in sparse 8-bit precision, operating at 400 MHz. Compared to state-of-the-art accelerators, the proposed design achieves a performance improvement of 1.1× to 3.9×.Keywords
Funding Information
- Science and Technology Planning Project of Guangzhou (2023B01J0007)
- National Natural Science Foundation (62301165)
- Basic and Applied Basic Research Foundation of Guangdong (2022A1515110774)
This publication has 30 references indexed in Scilit:
- An Area and Energy-Efficient Systolic Array Accelerator Architecture for Deep Neural Networks Using Stochastic ComputingIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2025
- EvGNN: An Event-Driven Graph Neural Network Accelerator for Edge VisionIEEE Transactions on Circuits and Systems for Artificial Intelligence, 2024
- Deep Neural Networks (DNN) based Sports Balls Classification2023
- 29.3 An 8.09TOPS/W Neural Engine Leveraging Bit-Sparsified Sign-Magnitude Multiplications and Dual Adder Trees2023
- SASCHA—Sparsity-Aware Stochastic Computing Hardware Architecture for Neural Network AccelerationIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022
- Post-Training Quantization for Longformer with Chunkwise Quantization Granularity and Optimized Percentile2022
- LSMQ: A Layer-Wise Sensitivity-Based Mixed-Precision Quantization Method for Bit-Flexible CNN Accelerator2021
- Research on Sentiment Classification of Active Scene Images Based on DNN2019
- DNN Training Based on Classic Gain Function for Single-channel Speech Enhancement and Recognition2019
- GXNOR-Net: Training deep neural networks with ternary weights and activations without full-precision memory under a unified discretization frameworkNeural Networks, 2018