Huabin Diao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Huabin Diao has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
Gongyan Li
3 shared publicationsShaoyun Xu
3 shared publications- Wei Wang
School of Computer and Information, Anhui Polytechnic University, Wuhu, China
2 shared publications Chao Kong
1 shared publication- Chao Kong
School of Computer and Information, Anhui Polytechnic University, Wuhu 241000, P. R. China
1 shared publication - Gongyan Li
Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China
1 shared publication
Latest Publications
- 28 August 2024
- Published by Elsevier in Pattern Recognition
- Vol. 157
Self-distillation enhanced adaptive pruning of convolutional neural networks
- 28 August 2024
- Published by Elsevier in Pattern Recognition
- Vol. 157
Self-distillation enhanced adaptive pruning of convolutional neural networks
- 10 November 2023
- Published by Elsevier in Neurocomputing
- Vol. 565
Attention Round for post-training quantization
- 10 November 2023
- Published by Elsevier in Neurocomputing
- Vol. 565
Attention Round for post-training quantization
- 5 January 2022
- Published by Springer Nature in Applied Intelligence
- Vol. 52 (8) , 9373-9387
PA-NAS: Partial operation activation for memory-efficient architecture search
- 5 January 2022
- Published by Springer Nature in Applied Intelligence
- Vol. 52 (8) , 9373-9387
PA-NAS: Partial operation activation for memory-efficient architecture search
- Open Access
Implementation of Lightweight Convolutional Neural Networks via Layer-Wise Differentiable Compression
Convolutional neural networks (CNNs) have achieved significant breakthroughs in various domains, such as natural language processing (NLP), and computer vision. However, performance improvement is often accompanied by large model size and computation costs, which make it not suitable for resource-constrained devices. Consequently, there is an urgent need to compress CNNs, so as to reduce model size and computation costs. This paper proposes a layer-wise differentiable compression (LWDC) algorithm for compressing CNNs structurally. A differentiable selection operator OS is embedded in the model to compress and train the model simultaneously by gradient descent in one go. Instead of pruning parameters from redundant operators by contrast to most of the existing methods, our method replaces the original bulky operators with more lightweight ones directly, which only needs to specify the set of lightweight operators and the regularization factor in advance, rather than the compression rate for each layer. The compressed model produced by our method is generic and does not need any special hardware/software support. Experimental results on CIFAR-10, CIFAR-100 and ImageNet have demonstrated the effectiveness of our method. LWDC obtains more significant compression than state-of-the-art methods in most cases, while having lower performance degradation. The impact of lightweight operators and regularization factor on the compression rate and accuracy also is evaluated.
Open AccessImplementation of Lightweight Convolutional Neural Networks via Layer-Wise Differentiable Compression
Convolutional neural networks (CNNs) have achieved significant breakthroughs in various domains, such as natural language processing (NLP), and computer vision. However, performance improvement is often accompanied by large model size and computation costs, which make it not suitable for resource-constrained devices. Consequently, there is an urgent need to compress CNNs, so as to reduce model size and computation costs. This paper proposes a layer-wise differentiable compression (LWDC) algorithm for compressing CNNs structurally. A differentiable selection operator OS is embedded in the model to compress and train the model simultaneously by gradient descent in one go. Instead of pruning parameters from redundant operators by contrast to most of the existing methods, our method replaces the original bulky operators with more lightweight ones directly, which only needs to specify the set of lightweight operators and the regularization factor in advance, rather than the compression rate for each layer. The compressed model produced by our method is generic and does not need any special hardware/software support. Experimental results on CIFAR-10, CIFAR-100 and ImageNet have demonstrated the effectiveness of our method. LWDC obtains more significant compression than state-of-the-art methods in most cases, while having lower performance degradation. The impact of lightweight operators and regularization factor on the compression rate and accuracy also is evaluated.