Hardware-Aware In Situ Learning Based on Stochastic Magnetic Tunnel Junctions
Top Cited Papers
Open Access
- 13 January 2022
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review Applied
- Vol. 17 (1) , 014016
Abstract
One of the big challenges of current electronics is the design and implementation of hardware neural networks that perform fast and energy-efficient machine learning. Spintronics is a promising catalyst for this field with the capabilities of nanosecond operation and compatibility with existing microelectronics. Considering large-scale, viable neuromorphic systems however, variability of device properties is a serious concern. In this paper, we show an autonomously operating circuit that performs hardware-aware machine learning utilizing probabilistic neurons built with stochastic magnetic tunnel junctions. We show that in situ learning of weights and biases in a Boltzmann machine can counter device-to-device variations and learn the probability distribution of meaningful operations such as a full adder. This scalable autonomously operating learning circuit using spintronics-based neurons could be especially of interest for standalone artificial-intelligence devices capable of fast and efficient learning at the edge.Keywords
All Related Versions
Funding Information
- Semiconductor Research Corporation
- DARPA
- CREST
- JSPS (19J12206)
- RIEC
- Science and Technology Center (CCF-0939370)
This publication has 40 references indexed in Scilit:
- Deep learningNature, 2015
- Deep learning in neural networks: An overviewNeural Networks, 2015
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- Thermal fluctuations of magnetic nanoparticles: Fifty years after BrownJournal of Applied Physics, 2012
- Representational Power of Restricted Boltzmann Machines and Deep Belief NetworksNeural Computation, 2008
- Large-angle, gigahertz-rate random telegraph switching induced by spin-momentum transferPhysical Review B, 2004
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- Simulating physics with computersInternational Journal of Theoretical Physics, 1982
- Thermal Fluctuations of a Single-Domain ParticlePhysical Review B, 1963
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951