Hierarchical Temporal Memory Features with Memristor Logic Circuits for Pattern Recognition
Open Access
- 31 August 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Vol. 37 (6) , 1143-1156
Abstract
Hierarchical temporal memory (HTM) is a machine learning algorithm inspired by the information processing mechanisms of the human neocortex and consists of a spatial pooler (SP) and temporal memory (TM). In this paper, we develop circuits and systems to achieve the optimized design of an HTM SP, an HTM TM and a memristive analog pattern matcher for pattern recognition applications. The HTM SP realizes an optimized hardware design through the introduction of mean overlap calculations and by replacing the threshold determination in the inhibition stage with a weighted summation operator over the neighborhood of the pixel under consideration. HTM TM is based on discrete analog memristive memory arrays and a weight update procedure. The operation of the proposed system is demonstrated for a face recognition problem, using the standard AR, ORL and Yale databases, and for speech recognition, using the TIMIT database, with achieved accuracies of 87.21% and approximately 90%, respectively, given an SNR of 10 dB. Visual data processing using binary HTM SP features requires less storage and processing memory than required by the traditional processing methods, with the area and power requirements for its implementation being 0.096 mm2 and 1756 mW, respectively. The design of the TM circuit for a single pixel requires 23.85 μm2 of area and 442.26 μW of power.Keywords
This publication has 19 references indexed in Scilit:
- The HTM Spatial Pooler—A Neocortical Algorithm for Online Sparse Distributed CodingFrontiers in Computational Neuroscience, 2017
- HTM Spatial Pooler With Memristor Crossbar Circuits for Sparse Biometric RecognitionIEEE Transactions on Biomedical Circuits and Systems, 2017
- Bioinspired memory model for HTM face recognition2016
- Continuous Online Sequence Learning with an Unsupervised Neural Network ModelNeural Computation, 2016
- A design of HTM spatial pooler for face recognition using memristor-CMOS hybrid circuits2016
- Pattern recognition using hierarchical concatenation2015
- Reconfigurable hardware architecture of the spatial pooler for hierarchical temporal memory2015
- Hierarchical Temporal Memory Based on Spin-Neurons and Resistive Memory for Energy-Efficient Brain-Inspired ComputingIEEE Transactions on Neural Networks and Learning Systems, 2015
- Online temporal pattern learning2009
- Evolution from analog to digital integration in aircraft avionics - a time of transitionIEEE Transactions on Aerospace and Electronic Systems, 2006