Monitoring of Urban Changes With Multimodal Sentinel 1 and 2 Data in Mariupol, Ukraine, in 2022/23
Open Access
- 6 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 5245-5265
Abstract
The ability to constantly monitor urban changes is of significant socio-economic interest, like detecting trends in urban expansion or tracking the vitality of urban areas. Especially in present conflict zones or disaster areas, such insights provide valuable information to keep track of the current situation. However, they are often subject to limited data availability in space and time. We built on our previous work, which used a transferred Deep Neural Network (DNN) operating on multi-modal Sentinel 1 and 2 data. In the current study, we have demonstrated and discussed its applicability in monitoring the present conflict zone of Mariupol, Ukraine, with high-temporal resolution Sentinel time series for the years 2022/23. A transfer to that conflict zone was challenging due to the limited availability of recent Very High Resolution (VHR) data. The current work had two objectives. First, transfer learning with older and publicly available VHR data was shown to be sufficient. That guaranteed the availability of more and less expensive data as time constraints were relaxed. Second, in an ablation study, we analyzed the effects of loss of observations to demonstrate the resiliency of our method. That was of particular interest due to the malfunctioning of Sentinel 1B shortly before the selected conflict. Our study demonstrated that urban change monitoring is possible for present conflict zones after transferring with older VHR data. It also indicated that, despite the multi-modal input, our method was more dependent on optical multispectral than Synthetic Aperture Radar (SAR) observations but resilient to loss of observations.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- A practically feasible transfer learning method for deep-temporal urban change monitoringInternational Journal of Remote Sensing, 2023
- Deep learning for change detection in remote sensing: a reviewGeo-spatial Information Science, 2022
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentationNature Methods, 2020
- Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-AnalysisIEEE Access, 2020
- ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed dataISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Systematic Evaluation of Image Tiling Adverse Effects on Deep Learning Semantic SegmentationFrontiers in Neuroscience, 2020
- A comparative study of impervious surface extraction using Sentinel-2 imageryEuropean Journal of Remote Sensing, 2020
- Enhanced normalized difference index for impervious surface area estimation at the plateau basin scaleJournal of Applied Remote Sensing, 2019
- Training Region-Based Object Detectors with Online Hard Example Mining2016
- ROC analysis of classifiers in machine learning: A surveyIntelligent Data Analysis: An International Journal, 2013