Prune it Yourself: Automated Pruning by Multiple Level Sensitivity
Authors:
- 1 August 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 73-78
Abstract
Deep neural network pruning is to reduce the model size by removing redundant structures and weights. Existing methods focus on single layer information which ignore other layers. And pruning progress is simply removing all weights at the same time. To address these limitations, we propose Prune it Yourself (PIY) framework. First, we collect both filter and channel sensitivity information. Then combine them to decide the structure to be pruned. At last we use the gradual pruning algorithm to reduce the accuracy loss without extra hyper-parameters. We use VGG-16 and ResNet to perform experiments on CIFAR-10 and ImageNet. The experimental results prove the effectiveness of our method.Keywords
This publication has 12 references indexed in Scilit:
- LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks2018
- AMC: AutoML for Model Compression and Acceleration on Mobile Devices2018
- Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks2018
- CLIP-Q: Deep Network Compression Learning by In-parallel Pruning-Quantization2018
- "Learning-Compression" Algorithms for Neural Net Pruning2018
- On Compressing Deep Models by Low Rank and Sparse Decomposition2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Deep Residual Learning for Image Recognition2016
- Fully convolutional networks for semantic segmentation2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014