Infrared Image Super-Resolution Network Utilizing the Enhanced Transformer and U-Net
Open Access
Abstract
Infrared images hold significant value in applications such as remote sensing and fire safety. However, infrared detectors often face the problem of high hardware costs, which limits their widespread use. Advancements in deep learning have spurred innovative approaches to image super-resolution (SR), but comparatively few efforts have been dedicated to the exploration of infrared images. To address this, we design the Residual Swin Transformer and Average Pooling Block (RSTAB) and propose the SwinAIR, which can effectively extract and fuse the diverse frequency features in infrared images and achieve superior SR reconstruction performance. By further integrating SwinAIR with U-Net, we propose the SwinAIR-GAN for real infrared image SR reconstruction. SwinAIR-GAN extends the degradation space to better simulate the degradation process of real infrared images. Additionally, it incorporates spectral normalization, dropout, and artifact discrimination loss to reduce the potential image artifacts. Qualitative and quantitative evaluations on various datasets confirm the effectiveness of our proposed method in reconstructing realistic textures and details of infrared images.Keywords
This publication has 54 references indexed in Scilit:
- Style transformation super-resolution GAN for extremely small infrared target imagePattern Recognition Letters, 2023
- CFMB-T: A cross-frequency multi-branch transformer for low-quality infrared remote sensing image super-resolutionInfrared Physics & Technology, 2023
- DASR: Dual-Attention Transformer for infrared image super-resolutionInfrared Physics & Technology, 2023
- HCTIRdeblur: A hybrid convolution-transformer network for single infrared image deblurringInfrared Physics & Technology, 2023
- Super resolution laser line scanning thermographyOptics and Lasers in Engineering, 2020
- Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanismApplied Intelligence, 2020
- Infrared image super-resolution via discriminative dictionary and deep residual networkInfrared Physics & Technology, 2020
- An infrared image super-resolution reconstruction method based on compressive sensingInfrared Physics & Technology, 2016
- Fast multisensor infrared image super-resolution scheme with multiple regression modelsJournal of Systems Architecture, 2016
- Remote sensing of geothermal-related minerals for resource exploration in NevadaGeothermics, 2015