RatUNet: residual U-Net based on attention mechanism for image denoising
Authors:
Open Access
- 10 May 2022
- journal article
- research article
- Published by PeerJ in PeerJ Computer Science
- Vol. 8, e970
Abstract
Deep convolutional neural networks (CNNs) have been very successful in image denoising. However, with the growth of the depth of plain networks, CNNs may result in performance degradation. The lack of network depth leads to the limited ability of the network to extract image features and difficults to fuse the shallow image features into the deep image information. In this work, we propose an improved deep convolutional U-Net framework (RatUNet) for image denoising. RatUNet improves Unet as follows: (1) RatUNet uses the residual blocks of ResNet to deepen the network depth, so as to avoid the network performance saturation. (2) RatUNet improves the down-sampling method, which is conducive to extracting image features. (3) RatUNet improves the up-sampling method, which is used to restore image details. (4) RatUNet improves the skip-connection method of the U-Net network, which is used to fuse the shallow feature information into the deep image details, and it is more conducive to restore the clean image. (5) In order to better process the edge information of the image, RatUNet uses depthwise and polarized self-attention mechanism to guide a CNN for image denoising. Extensive experiments show that our RatUNet is more efficient and has better performance than existing state-of-the-art denoising methods, especially in SSIM metrics, the denoising effect of the RatUNet achieves very high performance. Visualization results show that the denoised image by RatUNet is smoother and sharper than other methods.Keywords
Funding Information
- Research Project Supported by Shanxi Scholarship Council of China (2020-139)
This publication has 23 references indexed in Scilit:
- Fine-Tuning Convolutional Neural Networks for Biomedical Image Analysis: Actively and Incrementally2017
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image DenoisingIEEE Transactions on Image Processing, 2017
- Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image RestorationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Color demosaicking by local directional interpolation and nonlocal adaptive thresholdingJournal of Electronic Imaging, 2011
- Clustering-Based Denoising With Locally Learned DictionariesIEEE Transactions on Image Processing, 2009
- Image Denoising by Sparse 3-D Transform-Domain Collaborative FilteringIEEE Transactions on Image Processing, 2007
- An Iterative Regularization Method for Total Variation-Based Image RestorationMultiscale Modeling & Simulation, 2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Texture Decomposition by Harmonics Extraction From Higher Order StatisticsIEEE Transactions on Image Processing, 2004
- Iterative correction of intersymbol interference: Turbo‐equalizationEuropean Transactions on Telecommunications, 1995