Attention Mechanism Cloud Detection With Modified FCN for Infrared Remote Sensing Images
Open Access
- 22 October 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 150975-150983
Abstract
Semantic segmentation (SS) has been widely applied for cloud detection (CD) in remote sensing images (RSIs) with high spatial and spectral resolution because of its effective pixel-level feature extraction structure. However, the typical model of lightweight SS, namely the fully convolutional network (FCN) with only seven layers, has difficulty in extracting high-level features, and the heavy pyramid scene parsing network (PSPNet) with complicated calculations is not practical in real-time CD, let alone on-orbit CD. So, in view of the problems above, we propose a compact attention mechanism cloud detection network (AM-CDN) based on the modified FCN to refine and fuse the multi-scale features for on-orbit CD. Specifically, taking the FCN as the baseline, our model increases the numbers of hidden layers and adds the residual connections between the input and output to eliminate the network degradation and extract the advanced context feature maps effectively. To expand the receptive field without losing the spatial information, the ordinary convolutions in FCN are replaced by the dilated convolution in AM-CDN. And inspired by the selective kernels of human vision, we introduce the convolutional attention mechanism (AM) into the encoder to adaptively adjust the receptive field to highlight the key texture features. According to experimental results using Landsat-8 infrared RSIs, the accuracy of the proposed CD method is 95.31%, which is 10.17% higher than that of FCN. And the calculation complexity of AM-CDN is only 7.63% of that of PSPNet.Keywords
Funding Information
- CASEarth Minisatellite Thermal Infrared Spectrometer Project of the Shanghai Institute of Technical Physics, Chinese Academy of Sciences (XDA19010102)
- National Natural Science Foundation of China (61975222)
This publication has 29 references indexed in Scilit:
- Cloud Detection in Remote Sensing Images Based on Multiscale Features-Convolutional Neural NetworkIEEE Transactions on Geoscience and Remote Sensing, 2019
- Automatic Raft Labeling for Remote Sensing Images via Dual-Scale Homogeneous Convolutional Neural NetworkRemote Sensing, 2018
- Squeeze-and-Excitation Networks2018
- Pyramid Scene Parsing Network2017
- Cloud detection algorithm comparison and validation for operational Landsat data productsRemote Sensing of Environment, 2017
- Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imageryRemote Sensing of Environment, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep Residual Learning for Image Recognition2016
- Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: An algorithm designed specifically for monitoring land cover changeRemote Sensing of Environment, 2014
- Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: Refinements of the radiative transfer model and the input dataJournal of Geophysical Research: Atmospheres, 2004