Shift-CIM: In-SRAM Alignment To Support General-Purpose Bit-level Sparsity Exploration in SRAM Multiplication
Open Access
- 28 June 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 22 (2) , 1-25
Abstract
Multiplication plays a critical role in SRAM-based Computing-in-Memory (CIM) architectures. However, current SRAM-based CIMs face three major limitations. First, they do not fully exploit bit-level sparsity, resulting in unnecessary overhead in both latency and energy consumption. Second, the generation of numerous zero-dot products is superfluous. Third, the irregular organization of SRAM complicates the implementation. To address these issues, we propose Shift-CIM, a general-purpose approach that fully leverages bit-level sparsity within SRAM-based multiplications. Shift-CIM aligns the multipliers within the SRAM array, accumulating only the required dot products based on the non-zero bits of the multipliers. Shift-CIM achieves a regular SRAM organization by assembling two irregular SRAM arrays in a transposed manner. Our evaluations show that Shift-CIM is highly efficient, operating at a supply voltage of 0.9 V and a frequency of 833 MHz, while incurring only a 4.8% area overhead. Despite these modest requirements, Shift-CIM significantly accelerates multiplication operations, achieving up to 3.08× the performance improvement and a 60% reduction in energy consumption compared to state-of-the-art designs.Keywords
Funding Information
- National Natural Science Foundation of China (62272477)
- NSF of Hunan Province (2022JJ10066)
This publication has 38 references indexed in Scilit:
- VSPIM: SRAM Processing-in-Memory DNN Acceleration via Vector-Scalar OperationsIEEE Transactions on Computers, 2023
- A Fully Digital SRAM-Based Four-Layer In-Memory Computing Unit Achieving Multiplication Operations and Results StoreIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2023
- Designing Efficient Bit-Level Sparsity-Tolerant Memristive NetworksIEEE Transactions on Neural Networks and Learning Systems, 2023
- A Reliable 8T SRAM for High-Speed Searching and Logic-in-Memory OperationsIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2022
- In-/Near-Memory ComputingSynthesis Lectures on Computer Architecture, 2021
- Z-PIM: A Sparsity-Aware Processing-in-Memory Architecture With Fully Variable Weight Bit-Precision for Energy-Efficient Deep Neural NetworksIEEE Journal of Solid-State Circuits, 2021
- An Energy-Efficient Deep Convolutional Neural Network Inference Processor With Enhanced Output Stationary Dataflow in 65-nm CMOSIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2019
- DNN Engine: A 28-nm Timing-Error Tolerant Sparse Deep Neural Network Processor for IoT ApplicationsIEEE Journal of Solid-State Circuits, 2018
- A 45-nm Dual-Port SRAM Utilizing Write-Assist Cells Against Simultaneous Access DisturbancesIEEE Transactions on Circuits and Systems II: Express Briefs, 2012
- NVSim: A Circuit-Level Performance, Energy, and Area Model for Emerging Nonvolatile MemoryIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2012