Tolerance of intrinsic device variation in fuzzy restricted Boltzmann machine network based on memristive nano-synapses
- 24 April 2017
- journal article
- Published by IOP Publishing in Nano Futures
- Vol. 1 (1) , 015003
Abstract
Inspired by the architecture and principle of the human brain, neuromorphic computing has attracted enormous research interest due to its potential for massively parallel and energy-efficient computing, where nanoscale memristors are considered as perfect building blocks for hardware neural networks, serving as compact, analog synapses. However, the inherent variation in memristors has been regarded as a major obstacle to their practical application in neuromorphic computing. Here, for the first time, we demonstrate that this long-standing issue can be addressed by introducing fuzziness into the neural networks. We found that the cycle-to-cycle and device-to-device conductance variations in the on and off states of Pt/TaO x /Ta memristors statistically follow Gaussian distributions, and using an experimentally verified compact synapse model based on the electrical characteristics of Pt/TaO x /Ta devices, a fuzzy restricted Boltzmann machine (FRBM) network was constructed where all the weight states were fuzzified to accommodate device stochasticity. The FRBM network has shown significantly improved tolerance to device variation, as confirmed by increased accuracy in the benchmark test of MNIST handwritten digit classifications. This study thus provides a new route towards highly robust neuromorphic computing, even if the computing elements can be stochastic and inhomogeneous.Keywords
Funding Information
- Beijing Municipal Science & Technology Commission Program (Z161100000216148)
- National Natural Science Foundation of China (61376087, 61674006, 61574007, 61421005)
This publication has 30 references indexed in Scilit:
- Memristors with diffusive dynamics as synaptic emulators for neuromorphic computingNature Materials, 2016
- Engineering incremental resistive switching in TaOxbased memristors for brain-inspired computingNanoscale, 2016
- Memristive Physically Evolving Networks Enabling the Emulation of Heterosynaptic PlasticityAdvanced Materials, 2015
- Bioinspired Programming of Memory Devices for Implementing an Inference EngineProceedings of the IEEE, 2015
- Electronic system with memristive synapses for pattern recognitionScientific Reports, 2015
- Synaptic electronics: materials, devices and applicationsNanotechnology, 2013
- Nanoscale Memristor Device as Synapse in Neuromorphic SystemsNano Letters, 2010
- The missing memristor foundNature, 2008
- Neuromorphic electronic systemsProceedings of the IEEE, 1990
- Memristor-The missing circuit elementIEEE Transactions on Circuit Theory, 1971