Extraction of Water Bodies from High-Resolution Aerial and Satellite Images Using Visual Foundation Models
Open Access
- 3 April 2024
- journal article
- research article
- Published by MDPI AG in Sustainability
- Vol. 16 (7) , 2995
Abstract
Water, indispensable for life and central to ecosystems, human activities, and climate dynamics, requires rapid and accurate monitoring. This is vital for sustaining ecosystems, enhancing human welfare, and effectively managing land, water, and biodiversity on both the local and global level. In the rapidly evolving domain of remote sensing and deep learning, this study focuses on water body extraction and classification through the use of recent deep learning models of visual foundation models (VFMs). Specifically, the Segment Anything Model (SAM) and Contrastive Language-Image Pre-training (CLIP) models have shown promise in semantic segmentation, dataset creation, change detection, and instance segmentation tasks. A novel two-step approach involving segmenting images via the Automatic Mask Generator method of the SAM and the zero-shot classification of segments using CLIP is proposed, and its effectiveness is tested on water body extraction problems. The proposed methodology was applied to both remote sensing imagery acquired from LANDSAT 8 OLI and very high-resolution aerial imagery. Results revealed that the proposed methodology accurately delineated water bodies across complex environmental conditions, achieving a mean intersection over union (IoU) of 94.41% and an F1 score of 96.97% for satellite imagery. Similarly, for the aerial imagery dataset, the proposed methodology achieved a mean IoU of 90.83% and an F1 score exceeding 94.56%. The high accuracy achieved in selecting segments predominantly classified as water highlights the effectiveness of the proposed model in intricate environmental image analysis.Keywords
This publication has 50 references indexed in Scilit:
- Extraction of Surface Water Bodies using Optical Remote Sensing Images: A ReviewEarth Science Informatics, 2024
- Marine mucilage mapping with explained deep learning model using water-related spectral indices: a case study of Dardanelles Strait, TurkeyStochastic Environmental Research and Risk Assessment, 2023
- Exploring machine learning algorithms for accurate water level forecasting in Muda river, MalaysiaHeliyon, 2023
- Deep Learning for Automatic Extraction of Water Bodies Using Satellite ImageryJournal of the Indian Society of Remote Sensing, 2023
- Critical review on deep learning methodologies employed for water-body segmentation through remote sensing imagesMultimedia Tools and Applications, 2023
- Streamflow Prediction Utilizing Deep Learning and Machine Learning Algorithms for Sustainable Water Supply ManagementWater Resources Management, 2023
- Automatic extraction of highly risky coastal retreat zones using Google earth engine (GEE)International Journal of Environmental Science and Technology, 2022
- Deep multi-feature learning architecture for water body segmentation from satellite imagesJournal of Visual Communication and Image Representation, 2021
- An ensemble deep learning based shoreline segmentation approach (WaterNet) from Landsat 8 OLI imagesAdvances In Space Research, 2021
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015