Wavelet Integrated CNNs for Noise-Robust Image Classification
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7243-7252
Abstract
Convolutional Neural Networks (CNNs) are generally prone to noise interruptions, i.e., small image noise can cause drastic changes in the output. To suppress the noise effect to the final predication, we enhance CNNs by replacing max-pooling, strided-convolution, and average-pooling with Discrete Wavelet Transform (DWT). We present general DWT and Inverse DWT (IDWT) layers applicable to various wavelets like Haar, Daubechies, and Cohen, etc., and design wavelet integrated CNNs (WaveCNets) using these layers for image classification. In WaveCNets, feature maps are decomposed into the low-frequency and high-frequency components during the down-sampling. The low-frequency component stores main information including the basic object structures, which is transmitted into the subsequent layers to extract robust high-level features. The high-frequency components, containing most of the data noise, are dropped during inference to improve the noise-robustness of the WaveCNets. Our experimental results on ImageNet and ImageNet-C (the noisy version of ImageNet) show that WaveCNets, the wavelet integrated versions of VGG, ResNets, and DenseNet, achieve higher accuracy and better noise-robustness than their vanilla versions.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- SAR Image segmentation based on convolutional-wavelet neural network and markov random fieldPattern Recognition, 2017
- Deep Residual Learning for Image Recognition2016
- Mixed Pooling for Convolutional Neural Networks2014
- Invariant Scattering Convolution NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- De-noising by soft-thresholdingIEEE Transactions on Information Theory, 1995
- Wavelet networksIEEE Transactions on Neural Networks, 1992
- Neural network adaptive wavelets for signal representation and classificationOptical Engineering, 1992
- A theory for multiresolution signal decomposition: the wavelet representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989
- Certain Topics in Telegraph Transmission TheoryTransactions of the American Institute of Electrical Engineers, 1928