Always-On Speech Recognition Using TrueNorth, a Reconfigurable, Neurosynaptic Processor
Open Access
- 21 November 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 66 (6) , 996-1007
Abstract
Deep neural networks (DNN) have been shown to be very effective at solving challenging problems in several areas of computing, including vision, speech, and natural language processing. However, traditional platforms for implementing these DNNs are often very power hungry, which has lead to significant efforts in the development of configurable platforms capable of implementing these DNNs efficiently. One of these platforms, the IBM TrueNorth processor, has demonstrated very low operating power in performing visual computing and neural network classification tasks in real-time. The neuron computation, synaptic memory, and communication fabrics are all configurable, so that a wide range of network types and topologies can be mapped to TrueNorth. This reconfigurability translates into the capability to support a wide range of low-power functions in addition to feed-forward DNN classifiers, including for example, the audio processing functions presented here.In this work, we propose an end-to-end audio processing pipeline that is implemented entirely on a TrueNorth processor and designed to specifically leverage the highly-parallel, low-precision computing primitives TrueNorth offers. As part of this pipeline, we develop an audio feature extractor (LATTE) designed for implementation on TrueNorth, and explore the tradeoffs among several design variants in terms of accuracy, power, and performance. We customize the energy-efficient deep neuromorphic networks structures that our design utilizes as the classifier and show how classifier parameters can trade between power and accuracy. In addition to enabling a wide range of diverse functions, the reconfigurability of TrueNorth enables re-training and re-programming the system to satisfy varying energy, speed, area, and accuracy requirements. The resulting system's end-to-end power consumption can be as low as 14:43 mW, which would give up to 100 hours of continuous usage with button cell batteries (CR3023 1:5 Whr) or 450 hours with cellphone batteries (iPhone 6s 6:55 Whr).Keywords
Funding Information
- US National Science Foundation
- CCF (1317560)
- IBM
This publication has 33 references indexed in Scilit:
- TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic ChipIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Visual saliency on networks of neurosynaptic coresIBM Journal of Research and Development, 2015
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- Neuromorphic sensory systemsCurrent Opinion in Neurobiology, 2010
- Efficient Coding of Time-Relative Structure Using SpikesNeural Computation, 2005
- RASTA processing of speechIEEE Transactions on Speech and Audio Processing, 1994
- Perceptual linear predictive (PLP) analysis of speechThe Journal of the Acoustical Society of America, 1990
- The Spectro-Temporal Receptive FieldBiological Cybernetics, 1981
- Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentencesIEEE Transactions on Acoustics, Speech, and Signal Processing, 1980