Generative Shadow Synthesis and Removal for Remote Sensing Images Through Embedding Illumination Models
- 16 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Abstract
Shadows significantly reduce the available information in remote sensing images, obstructing downstream tasks such as object detection, scene classification, and localization. However, shadow removal from remote sensing images is still an open issue, for the following reasons. Firstly, deep neural networks are difficult to train since the corresponding ground truths of shadows are almost always unavailable in practice. Secondly, the existing shadow removal methods still suffer from blurry details and boundary artifacts. In this paper, we describe how a generative shadow synthesis and removal framework that couples data-driven methods with illumination models was developed to address the above challenges effectively. Various shadows were synthesized in shadow-free regions of remote sensing images by GSS-Net, which is a generative shadow synthesis network that considers the physical process of shadow illumination attenuation. In this way, a large-scale, diverse, and realistic shadow dataset (RS-SynShadow) was built. A generative shadow removal network—GSR-Net—embedding a histogram-enhanced illumination model, was then developed for high-fidelity shadow removal without artifacts. Extensive experiments conducted on synthetic and real data demonstrate that the proposed shadow synthesis and removal framework significantly outperforms the state-of-the-art methods, both visually and quantitatively. The dataset and code will be made available at https://github.com/fzzfRS/RS-GSSR.Keywords
Funding Information
- National Natural Science Foundation of China (42371366, 42422109)
This publication has 58 references indexed in Scilit:
- Airborne-Shadow: Towards Fine-Grained Shadow Detection in Aerial Imagery2024
- Deeply supervised convolutional neural network for shadow detection based on a novel aerial shadow imagery datasetISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Shadow removal based on separated illumination correction for urban aerial remote sensing imagesSignal Processing, 2019
- ShadowGAN: Shadow synthesis for virtual objects with conditional adversarial networksComputational Visual Media, 2019
- Near real-time shadow detection and removal in aerial motion imagery applicationISPRS Journal of Photogrammetry and Remote Sensing, 2018
- A New Shadow Removal Method Using Color-Lines2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Shadow detection in very high spatial resolution aerial images: A comparative studyISPRS Journal of Photogrammetry and Remote Sensing, 2013
- Object-based land cover classification of shaded areas in high spatial resolution imagery of urban areas: A comparison studyRemote Sensing of Environment, 2009
- Entropy Minimization for Shadow RemovalInternational Journal of Computer Vision, 2009