10T SRAM Computing-in-Memory Macros for Binary and Multibit MAC Operation of DNN Edge Processors
Open Access
- 12 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 71262-71276
Abstract
Computing-in-memory (CIM) is a promising approach to reduce latency and improve the energy efficiency of the multiply-and-accumulate (MAC) operation under a memory wall constraint for artificial intelligence (AI) edge processors. This paper proposes an approach focusing on scalable CIM designs using a new ten-transistor (10T) static random access memory (SRAM) bit-cell. Using the proposed 10T SRAM bit-cell, we present two SRAM-based CIM (SRAM-CIM) macros supporting multibit and binary MAC operations. The first design achieves fully parallel computing and high throughput using 32 parallel binary MAC operations. Advanced circuit techniques such as an input-dependent dynamic reference generator and an input-boosted sense amplifier are presented. Fabricated in 28 nm CMOS process, this design achieves 409.6 GOPS throughput, 1001.7 TOPS/W energy efficiency, and a 169.9 TOPS/mm 2 throughput area efficiency. The proposed approach effectively solves previous problems such as writing disturb, throughput, and the power consumption of an analog to digital converter (ADC). The second design supports multibit MAC operation (4-b weight, 4-b input, and 8-b output) to increase the inference accuracy. We propose an architecture that divides 4-b weight and 4-b input multiplication to four 2-b multiplication in parallel, which increases the signal margin by 16× compared to conventional 4-b multiplication. Besides, the capacitive digital-to-analog converter (CDAC) area issue is effectively addressed using the intrinsic bit-line capacitance existing in the SRAM-CIM architecture. The proposed approach of realizing four 2-b parallel multiplication using the CDAC is successfully demonstrated with a modified LeNet-5 neural network. These results demonstrate that the proposed 10T bit-cell is promising for realizing robust and scalable SRAM-CIM designs, which is essential for realizing fully parallel edge computing.Keywords
Funding Information
- Basic Science Research Program through the National Research Foundation of Korea (2021R1A2B5B01001475)
- National Research and Development Program through the National Research Foundation of Korea funded by the Ministry of Science and ICT (2020M3H2A1076786)
This publication has 29 references indexed in Scilit:
- Training Deep Neural Networks for the Inverse Design of Nanophotonic StructuresACS Photonics, 2018
- Applications of Deep Learning and Reinforcement Learning to Biological DataIEEE Transactions on Neural Networks and Learning Systems, 2018
- A Multi-Functional In-Memory Inference Processor Using a Standard 6T SRAM ArrayIEEE Journal of Solid-State Circuits, 2018
- An Energy-Efficient Precision-Scalable ConvNet Processor in 40-nm CMOSIEEE Journal of Solid-State Circuits, 2017
- In-Memory Computation of a Machine-Learning Classifier in a Standard 6T SRAM ArrayIEEE Journal of Solid-State Circuits, 2017
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- DeepFace: Closing the Gap to Human-Level Performance in Face Verification2014
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- A 3-GHz 70-Mb SRAM in 65-nm CMOS Technology With Integrated Column-Based Dynamic Power SupplyIEEE Journal of Solid-State Circuits, 2005
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998