Group Scissor
Authors:
Open Access
- 18 June 2017
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Abstract
Synapse crossbar is an elementary structure in neuromorphic computing systems (NCS). However, the limited size of crossbars and heavy routing congestion impede the NCS implementation of large neural networks. In this paper, we propose a two-step framework (namely, group scissor) to scale NCS designs to large neural networks. The first step rank clipping integrates low-rank approximation into the training to reduce total crossbar area. The second step is group connection deletion, which structurally prunes connections to reduce routing congestion between crossbars. Tested on convolutional neural networks of LeNet on MNIST database and ConvNet on CIFAR-10 database, our experiments show significant reduction of crossbar and routing area in NCS designs. Without accuracy loss, rank clipping reduces the total crossbar area to 13.62% or 51.81% in the NCS design of LeNet or ConvNet, respectively. The following group connection deletion further decreases the routing area of LeNet or ConvNet to 8.1% or 52.06%, respectively.Keywords
Funding Information
- AFRL (FA8750-15-2-0048)
- NSF (XPS-1337198)
This publication has 9 references indexed in Scilit:
- A new learning method for inference accuracy, core occupation, and performance co-optimization on TrueNorth chip2016
- Deep Residual Learning for Image Recognition2016
- TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic ChipIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2015
- An EDA framework for large scale hybrid neuromorphic computing systems2015
- Cross-Point Memory Array Without Cell Selectors—Device Characteristics and Data Storage Pattern DependenciesIEEE Transactions on Electron Devices, 2010
- Nanoscale Memristor Device as Synapse in Neuromorphic SystemsNano Letters, 2010
- The missing memristor foundNature, 2008
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998