A Novel Dense-Attention Network for Thick Cloud Removal by Reconstructing Semantic Information
Open Access
- 11 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 16 (19391404) , 2339-2351
Abstract
The presence of thick clouds in single optical images shows the contamination of interesting objects. Besides, the difficulty of thick cloud removal is mainly the restoration of the weak boundary information from cloud-contaminated areas. Recently, many deep-learning-based frameworks were applied for cloud removal by obtain the related semantic information from the weak boundary information. However, the large-size cloud-contaminated areas lead to the artificial textures in the resulting images. Thus, obtaining the optimal semantic information from finite boundary information is the key to solve this problem. In this work, we design a deep-learning framework for cloud removal, especially large-size clouds removal (i.e., more than 30% coverage of the whole image). First, we design a cloud location model (CLM) which adopted the fully convolutional network to locate the cloud. Second, desired by theory of the coarse-to-fine restoration, we build a dense-attention network (termed as DANet) for restoring cloud contaminated areas. In the DANet, we design a dense block into the coarse network for training the features of restoring directions of each pixel from the weak boundary information. Furthermore, a contextual attention module is built into refinement network for restoring contaminated areas relying on the semantic relationship between the background and foreground information. Compared with the state-of-the-art methods, the proposed DANet achieved greater removal performances and reconstruct more natural image textures.Keywords
This publication has 31 references indexed in Scilit:
- Cloud Removal Based on Sparse Representation via Multitemporal Dictionary LearningIEEE Transactions on Geoscience and Remote Sensing, 2016
- Missing Information Reconstruction of Remote Sensing Data: A Technical ReviewIEEE Geoscience and Remote Sensing Magazine, 2015
- Fully convolutional networks for semantic segmentation2015
- Remote-sensing image analysis and geostatisticsInternational Journal of Remote Sensing, 2012
- Evaluating Inpainting Methods to the Satellite Images Clouds and Shadows Removing2011
- Single Image Haze Removal Using Dark Channel PriorIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Single image dehazingACM Transactions on Graphics, 2008
- The availability of cloud-free Landsat ETM+ data over the conterminous United States and globallyRemote Sensing of Environment, 2008
- Gaps‐fill of SLC‐off Landsat ETM+ satellite image using a geostatistical approachInternational Journal of Remote Sensing, 2007
- Kriging in the shadows: Geostatistical interpolation for remote sensingRemote Sensing of Environment, 1994