Research on ground-based cloud image classification combining local and global features
Authors:
- 1 July 2024
- journal article
- research article
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 33 (04) , 1-21
Abstract
Clouds are an important factor in predicting future weather changes. Cloud image classification is one of the basic issues in the field of ground-based cloud meteorological observation. Deep CNN mainly focuses on the local receptive field, and the processing of global information may be relatively weak. In ground-based cloud image classification, if there is a complex background, it will help to better model the long-range dependence of the image if the relationship between different locations in the image can be globally captured. A ground-based cloud image classification method is proposed based on the fusion of local features and global features (LG_CloudNet). The ground-based cloud image classification method integrates the global feature extraction module (GF_M) and the local feature extraction module (LF_M), using the attention mechanism to weight and merge features, respectively. The LG_CloudNet model enables richer and comprehensive feature representation at lower computational complexity. In order to ensure the learning and generalization capabilities of the model during training, AdamW (Adam weight decay) is combined with learning rate warm-up and stochastic gradient descent with warm restarts methods to adjust the learning rate. The experimental results demonstrate that the proposed method achieves favorable ground-based cloud image classification outcomes and exhibits robust performance in classifying cloud images. In the datasets of GCD, CCSN, and ZNCL, the classification accuracy is 94.94%, 95.77%, and 98.87%, respectively.Keywords
This publication has 28 references indexed in Scilit:
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- A review on deep learning techniques for cloud detection methodologies and challengesSignal, Image and Video Processing, 2021
- CloudU-Netv2: A Cloud Segmentation Method for Ground-Based Cloud Images Based on Deep LearningNeural Processing Letters, 2021
- Deep tensor fusion network for multimodal ground-based cloud classification in weather station networksAd Hoc Networks, 2020
- Dual Guided Loss for Ground-Based Cloud Classification in Weather Station NetworksIEEE Access, 2019
- CloudNet: Ground‐Based Cloud Classification With Deep Convolutional Neural NetworkGeophysical Research Letters, 2018
- Multimodal GAN for Energy Efficiency and Cloud Classification in Internet of ThingsIEEE Internet of Things Journal, 2018
- Ground-based cloud classification by learning stable local binary patternsAtmospheric Research, 2018
- Deep Convolutional Activations-Based Features for Ground-Based Cloud ClassificationIEEE Geoscience and Remote Sensing Letters, 2017
- Salient local binary pattern for ground-based cloud classificationJournal of Meteorological Research, 2013