Addressing Fine-Grained Lake Water Body Extraction: A Hybrid Approach Combining Vision Transformer and Geodesic Active Contour
- 21 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-14
Abstract
In remote sensing image analyses, the extraction of lake water bodies has been emphasized owing to its pivotal role in interpreting aquatic ecosystems, assessing hydrological trends, and detecting environmental changes. Although deep-learning-based techniques have been effectively deployed for this task, several challenges persist, including mis-segmentation of low-contrast regions, insufficient delineation of fuzzy boundaries, and over-segmentation in micro-regions. To address these issues, an innovative, end-to-end segmentation framework is proposed in this study. This framework ingeniously integrates the Geodesic Active Contour (GAC) model with the Vision Transformer (ViT) architecture, thereby offering a robust solution for fain-gained lake water body extraction. Specifically, the conventional GAC model is first revisited and reformulated. Subsequently, the Differentiable Spectral Clustering (DSC) module is designed for automatic contour initialization and lifts the dependence on hard threshold binarization. Finally, an iterative learning strategy is introduced to integrate the aforementioned models within the ViT architecture. This strategy serves to constrain the geometric characteristics, while also permitting dynamic adjustment of evolution parameters, facilitating enhanced refinement of spatial details and accuracy in segmentation results. Comprehensive experiments conducted on the newly constructed Global Lake View (GLV) dataset and a public benchmark demonstrated that the proposed method yields precise lake boundaries and achieves state-of-the-art performance.Keywords
Funding Information
- National Natural Science Foundation of China (62071437)
- National Key Research and Development Program of China (2019YFB1704500, 2022YFB3306200)
- State Ministry of Science and Technology Innovation Fund of China (2018IM030200)
- national natural foundation of China (U1708255)
This publication has 46 references indexed in Scilit:
- Critical review on deep learning methodologies employed for water-body segmentation through remote sensing imagesMultimedia Tools and Applications, 2023
- Enhancement multi-module network for few-shot leaky cable fixture detection in railway tunnelSignal Processing: Image Communication, 2023
- Semantic segmentation of water bodies in very high-resolution satellite and aerial imagesRemote Sensing of Environment, 2023
- Probabilistic SAR-based water segmentation with adapted Bayesian convolutional neural networkRemote Sensing of Environment, 2022
- PLOP: Learning without Forgetting for Continual Semantic Segmentation2021
- River network delineation from Sentinel-1 SAR dataInternational Journal of Applied Earth Observation and Geoinformation, 2019
- Densely Connected Convolutional Networks2017
- Deep Residual Learning for Image Recognition2016
- A new active contour remote sensing river image segmentation algorithm inspired from the cross entropyDigital Signal Processing, 2016
- Globally Optimal Geodesic Active ContoursJournal of Mathematical Imaging and Vision, 2005