Multiscale Attention Feature Aggregation Network for Cloud and Cloud Shadow Segmentation
- 6 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 61 (01962892) , 1-16
Abstract
Cloud and cloud shadow segmentation is one of the most important problems in remote sensing image processing. Due to the vulnerability to ground object interference, noise interference and other factors, and the lack of generalization ability, traditional deep learning network would inevitably lose details and spatial information, resulting in imprecise segmentation of cloud and cloud shadow boundaries, missing detection and false detection. In order to solve these problems, a multi-scale attention feature aggregation network is proposed, which extracts semantic information at different levels based on residual network. A multi-scale strip pooling attention module is designed to extract multi-scale context information and deep spatial channel information. In order to improve the feature extraction of the model, the deep multi-head feedforward transfer attention module is introduced to enable the adjacent two layers of the backbone network to guide each other for feature mining. Then, a bilateral feature fusion module is used to guide the fusion of low-level semantic information and high-level detail information. Finally, in order to enhance the repair of boundary details of cloud and cloud shadow, a boundary refinement boosting model is designed. The experimental results show that our model can handle complex cloud cover scenes, and has excellent performance on cloud, cloud shadow dataset and CSWV dataset. Its segmentation accuracy is superior to the existing methods, which is of great significance to the related work of cloud detection.Keywords
Funding Information
- National Natural Science Foundation of China (42075130)
This publication has 42 references indexed in Scilit:
- Deep Residual Learning for Image Recognition2016
- Fully Convolutional Networks for Semantic SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- High-Resolution SAR Image Classification via Deep Convolutional AutoencodersIEEE Geoscience and Remote Sensing Letters, 2015
- Dempster–Shafer Fusion of Multiple Sparse Representation and Statistical Property for SAR Target Configuration RecognitionIEEE Geoscience and Remote Sensing Letters, 2013
- Object-based cloud and cloud shadow detection in Landsat imageryRemote Sensing of Environment, 2012
- A Geometry-Based Approach to Identifying Cloud Shadows in the VIIRS Cloud Mask Algorithm for NPOESSJournal of Atmospheric and Oceanic Technology, 2009
- Developing clear-sky, cloud and cloud shadow mask for producing clear-sky composites at 250-meter spatial resolution for the seven MODIS land bands over Canada and North AmericaRemote Sensing of Environment, 2008
- New Cloud Detection Algorithm for Multispectral and Hyperspectral Images: Application to ENVISAT/MERIS and PROBA/CHRIS Sensors2006
- Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: Refinements of the radiative transfer model and the input dataJournal of Geophysical Research: Atmospheres, 2004
- A study of cloud classification with neural networks using spectral and textural featuresIEEE Transactions on Neural Networks, 1999