Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks
Preprint
Abstract
Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise separable convolution has been proposed for image recognition tasks on computationally limited platforms such as robotics and self-driving cars. Though it is much faster than its counterpart, regular convolution, accuracy is sacrificed. In this paper, we propose a novel decomposition approach based on SVD, namely depth-wise decomposition, for expanding regular convolutions into depthwise separable convolutions while maintaining high accuracy. We show our approach can be further generalized to the multi-channel and multi-layer cases, based on Generalized Singular Value Decomposition (GSVD) [59]. We conduct thorough experiments with the latest ShuffleNet V2 model [47] on both random synthesized dataset and a large-scale image recognition dataset: ImageNet [10]. Our approach outperforms channel decomposition [73] on all datasets. More importantly, our approach improves the Top-1 accuracy of ShuffleNet V2 by ~2%.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Feature Selective Anchor-Free Module for Single-Shot Object Detection2019
- Learning Transferable Architectures for Scalable Image Recognition2018
- Shift: A Zero FLOP, Zero Parameter Alternative to Spatial Convolutions2018
- Validation of a smart shoe for estimating foot progression angle during walking gaitJournal of Biomechanics, 2017
- Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning2017
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer Vision, 2017
- Fast ConvNets Using Group-Wise Brain Damage2016
- Channel-level acceleration of deep face representationsIEEE Access, 2015
- Regularized linear and kernel redundancy analysisComputational Statistics & Data Analysis, 2007
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998