Snow Detection in Gaofen-1 Multi-Spectral Images Based on Swin-Transformer and U-Shaped Dual-Branch Encoder Structure Network with Geographic Information
Open Access
- 8 September 2024
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 16 (17) , 3327
Abstract
Snow detection is imperative in remote sensing for various applications, including climate change monitoring, water resources management, and disaster warning. Recognizing the limitations of current deep learning algorithms in cloud and snow boundary segmentation, as well as issues like detail snow information loss and mountainous snow omission, this paper presents a novel snow detection network based on Swin-Transformer and U-shaped dual-branch encoder structure with geographic information (SD-GeoSTUNet), aiming to address the above issues. Initially, the SD-GeoSTUNet incorporates the CNN branch and Swin-Transformer branch to extract features in parallel and the Feature Aggregation Module (FAM) is designed to facilitate the detail feature aggregation via two branches. Simultaneously, an Edge-enhanced Convolution (EeConv) is introduced to promote snow boundary contour extraction in the CNN branch. In particular, auxiliary geographic information, including altitude, longitude, latitude, slope, and aspect, is encoded in the Swin-Transformer branch to enhance snow detection in mountainous regions. Experiments conducted on Levir_CS, a large-scale cloud and snow dataset originating from Gaofen-1, demonstrate that SD-GeoSTUNet achieves optimal performance with the values of 78.08%, 85.07%, and 92.89% for , , and , respectively, leading to superior cloud and snow boundary segmentation and thin cloud and snow detection. Further, ablation experiments reveal that integrating slope and aspect information effectively alleviates the omission of snow detection in mountainous areas and significantly exhibits the best vision under complex terrain. The proposed model can be used for remote sensing data with geographic information to achieve more accurate snow extraction, which is conducive to promoting the research of hydrology and agriculture with different geospatial characteristics.
Keywords
Funding Information
- advanced research on civil space technology during the 14th Five-Year Plan (D040405, 92037000, 42375040, 42161054, 42205153, 2022KFKTC003, NMICJY202307, NMICJY202305, 202302035765)
- National Science Foundation of China (D040405, 92037000, 42375040, 42161054, 42205153, 2022KFKTC003, NMICJY202307, NMICJY202305, 202302035765)
- Open Foundation of the Key Laboratory of Coupling Process and Effect of Natural Resources Elements (D040405, 92037000, 42375040, 42161054, 42205153, 2022KFKTC003, NMICJY202307, NMICJY202305, 202302035765)
- National Meteorological Information Center of China Meteorological (D040405, 92037000, 42375040, 42161054, 42205153, 2022KFKTC003, NMICJY202307, NMICJY202305, 202302035765)
- GHFUND C (D040405, 92037000, 42375040, 42161054, 42205153, 2022KFKTC003, NMICJY202307, NMICJY202305, 202302035765)
This publication has 58 references indexed in Scilit:
- Improve the downscaling accuracy of high-resolution precipitation field using classification maskAtmospheric Research, 2024
- A survey of machine learning and deep learning in remote sensing of geological environment: Challenges, advances, and opportunitiesISPRS Journal of Photogrammetry and Remote Sensing, 2023
- Bayesian Deep Learning for Spatial Interpolation in the Presence of Auxiliary InformationMathematical Geosciences, 2022
- Pan-European meteorological and snow indicators of climate change impact on ski tourismClimate Services, 2021
- A geographic information-driven method and a new large scale dataset for remote sensing cloud/snow detectionISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Spatiotemporal variation of snowline altitude at the end of melting season across High Mountain Asia, using MODIS snow cover productAdvances In Space Research, 2020
- Snow and glacier melt runoff simulation under variable altitudes and climate scenarios in Gilgit River Basin, Karakoram regionModeling Earth Systems and Environment, 2020
- A co-training, mutual learning approach towards mapping snow cover from multi-temporal high-spatial resolution satellite imageryISPRS Journal of Photogrammetry and Remote Sensing, 2016
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Development of methods for mapping global snow cover using moderate resolution imaging spectroradiometer dataRemote Sensing of Environment, 1995