CloudRCNN: A Framework Based on Deep Neural Networks for Semantic Segmentation of Satellite Cloud Images
Open Access
- 26 May 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (11) , 5370
Abstract
Shadow cumulus clouds are widely distributed globally. They carry critical information to analyze environmental and climate changes. They can also shape the energy and water cycles of the global ecosystem at multiple scales by impacting solar radiation transfer and precipitation. Satellite images are an important source of cloud data. The accurate detection and segmentation of clouds is of great significance for climate and environmental monitoring. In this paper, we propose an improved MaskRCNN framework for the semantic segmentation of satellite images. We also explore two deep neural network architectures using auxiliary loss and feature fusion functions. We conduct comparative experiments on the dataset called “Understanding Clouds from Satellite Images”, sourced from the Kaggle competition. Compared to the baseline model, MaskRCNN, the mIoU of the CloudRCNN (auxiliary loss) model improves by 15.24%, and that of the CloudRCNN (feature fusion) model improves by 12.77%. More importantly, the two neural network architectures proposed in this paper can be widely applied to various semantic segmentation neural network models to improve the distinction between the foreground and the background.Keywords
This publication has 36 references indexed in Scilit:
- Superpixels: An evaluation of the state-of-the-artComputer Vision and Image Understanding, 2018
- Level Set Segmentation Algorithm for High-Resolution Polarimetric SAR Images Based on a Heterogeneous Clutter ModelIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017
- A Median Regularized Level Set for Hierarchical Segmentation of SAR ImagesIEEE Geoscience and Remote Sensing Letters, 2017
- A cloud detection algorithm-generating method for remote sensing data at visible to short-wave infrared wavelengthsISPRS Journal of Photogrammetry and Remote Sensing, 2017
- An Iterative Haze Optimized Transformation for Automatic Cloud/Haze Detection of Landsat ImageryIEEE Transactions on Geoscience and Remote Sensing, 2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Automated coronal hole segmentation from Solar EUV Images using the watershed transformJournal of Visual Communication and Image Representation, 2015
- Spatial and Temporal Distribution of Clouds Observed by MODIS Onboard the Terra and Aqua SatellitesIEEE Transactions on Geoscience and Remote Sensing, 2013
- Watershed Cuts: Thinnings, Shortest Path Forests, and Topological WatershedsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979