A Sparse Coding Neural Network ASIC With On-Chip Learning for Feature Extraction and Encoding
Authors:
- 20 January 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 50 (4) , 1070-1079
Abstract
Hardware-based computer vision accelerators will be an essential part of future mobile devices to meet the low power and real-time processing requirement. To realize a high energy efficiency and high throughput, the accelerator architecture can be massively parallelized and tailored to vision processing, which is an advantage over software-based solutions and general-purpose hardware. In this work, we present an ASIC that is designed to learn and extract features from images and videos. The ASIC contains 256 leaky integrate-and-fire neurons connected in a scalable two-layer network of 8 × 8 grids linked in a 4-stage ring. Sparse neuron activation and the relatively small grid keep the spike collision probability low to save access arbitration. The weight memory is divided into core memory and auxiliary memory, such that the auxiliary memory is only powered on for learning to save inference power. High-throughput inference is accomplished by the parallel operation of neurons. Efficient learning is implemented by passing parameter update messages, which is further simplified by an approximation technique. A 3.06 mm 2 65 nm CMOS ASIC test chip is designed to achieve a maximum inference throughput of 1.24 Gpixel/s at 1.0 V and 310 MHz, and on-chip learning can be completed in seconds. To improve the power consumption and energy efficiency, core memory supply voltage can be reduced to 440 mV to take advantage of the error resilience of the algorithm, reducing the inference power to 6.67 mW for a 140 Mpixel/s throughput at 35 MHz.Keywords
Funding Information
- Defense Advanced Research Projects Agency (DARPA) under Cooperative Agreement HR0011-13-2-0015
This publication has 21 references indexed in Scilit:
- SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network SimulationIEEE Journal of Solid-State Circuits, 2013
- An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision SensorsIEEE Journal of Solid-State Circuits, 2011
- A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm2011
- A 201.4 GOPS 496 mW Real-Time Multi-Object Recognition Processor With Bio-Inspired Neural Perception EngineIEEE Journal of Solid-State Circuits, 2009
- A 125 GOPS 583 mW Network-on-Chip Based Parallel Processor With Bio-Inspired Visual Attention EngineIEEE Journal of Solid-State Circuits, 2008
- Sparse Coding via Thresholding and Local Competition in Neural CircuitsNeural Computation, 2008
- Dynamically Reconfigurable Silicon Array of Spiking Neurons With Conductance-Based SynapsesIEEE Transactions on Neural Networks, 2007
- A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fieldsJournal of Computational Neuroscience, 2006
- A VLSI Array of Low-Power Spiking Neurons and Bistable Synapses With Spike-Timing Dependent PlasticityIEEE Transactions on Neural Networks, 2006
- What Is the Goal of Sensory Coding?Neural Computation, 1994