STT-BNN: A Novel STT-MRAM In-Memory Computing Macro for Binary Neural Networks
Open Access
- 22 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
- Vol. 12 (2) , 569-579
Abstract
This paper presents a novel architecture for in-memory computation of binary neural network (BNN) workloads based on STT-MRAM arrays. In the proposed architecture, BNN inputs are fed through bitlines, then, a BNN vector multiplication can be done by single sensing of the merged SL voltage of a row. Our design allows to perform unrestricted accumulation across rows for full utilization of the array and BNN model scalability, and overcomes challenges on the sensing circuit due to the limitation of low regular tunneling magnetoresistance ratio (TMR) in STT-MRAM. Circuit techniques are introduced in the periphery to make the energy-speed-area-robustness tradeoff more favorable. In particular, time-based sensing (TBS) and boosting are introduced to enhance the accuracy of the BNN computations. System simulations show 80.01% (98.42%) accuracy under the CIFAR-10 (MNIST) dataset under the effect of local and global process variations, corresponding to an 8.59% (0.38%) accuracy loss compared to the original BNN software implementation, while achieving an energy efficiency of 311 TOPS/W.Keywords
Funding Information
- National Research & Development Program through the National Research Foundation of Korea
- Ministry of Science and ICT (2020M3F3A2A01085755)
- “CogniVision” and National Research Foundation Singapore (NRF-CRP20-2017-0003)
- Vietnam National Foundation for Science and Technology Development (102.01-2018.310)
This publication has 29 references indexed in Scilit:
- A 65nm 1Mb nonvolatile computing-in-memory ReRAM macro with sub-16ns multiply-and-accumulate for binary DNN AI edge processors2018
- Fully parallel RRAM synaptic array for implementing binary neural network with (+1, −1) weights and (+1, 0) neurons2018
- Computing in Memory With Spin-Transfer Torque Magnetic RAMIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2017
- A Novel Framework to Estimate the Path Delay Variability On the Back of an Envelope via the Fan-Out-of-4 MetricIEEE Transactions on Circuits and Systems I: Regular Papers, 2017
- Binary neural network with 16 Mb RRAM macro chip for classification and online training2016
- Novel Boosted-Voltage Sensing Scheme for Variation-Resilient STT-MRAM ReadIEEE Transactions on Circuits and Systems I: Regular Papers, 2016
- Spin-transfer torque magnetic random access memory (STT-MRAM)ACM Journal on Emerging Technologies in Computing Systems, 2013
- Spin-Transfer Torque MRAMs for Low Power Memories: Perspective and ProspectiveIEEE Sensors Journal, 2011
- Design space and scalability exploration of 1T-1STT MTJ memory arrays in the presence of variability and disturbances2009
- Probability and Statistics for Engineers and Scientists.1978