Geometry‐guided semantic segmentation for post‐earthquake buildings using optical remote sensing images
- 6 July 2023
- journal article
- research article
- Published by Wiley in Earthquake Engineering & Structural Dynamics
- Vol. 52 (11) , 3392-3413
Abstract
Deep‐learning‐based automatic recognition of post‐earthquake damage for urban buildings is increasingly in demand for rapid and precise assessment of seismic hazards from optical remote sensing images. In this study, a novel loss function fusing geometric consistency constraint (GCC) with cross‐entropy (CE) loss is designed for post‐earthquake building segmentation with complex geometric features across multiple scales. Specifically, the GCC loss incorporates three critical components, namely, split line length, curvature, and area, and enables the exact extraction of the geometric constraints of boundary and region for damaged buildings. Through the optimization of multiple key coefficients of GCC loss, the proposed method achieves significant performance improvements in semantic segmentation, which is attributed to the enhanced ability to identify and capture the pixel relationship near the boundary. Merging GCC in the loss function enables faster and more accurate convergence of predicted values towards the ground truth during the training process, surpassing the performance of the CE loss alone. The results show that the combination of GCC and CE losses achieves the largest validation mIoU of 86.98% for damaged buildings segmentation, which facilitates post‐earthquake assessment with high accuracy. Moreover, incorporating GCC leads to more precise and robust seismic damage segmentation by effectively improving edge closure, removing internal noise, and reducing false‐positive and false‐negative misrecognition. In addition, the GCC term further validates the effectiveness of improving segmentation tasks for other networks (e.g., DeepLabv3+). The GCC‐derived method exhibits its desirable performance on segmentation accuracy, portability, and universality for building recognition with complex geometric features and post‐earthquake scenes.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFC1511005)
- China Postdoctoral Science Foundation (BX20190102, 2019M661286)
This publication has 60 references indexed in Scilit:
- Deep learningNature, 2015
- Data‐driven post‐earthquake rapid structural safety assessmentEarthquake Engineering & Structural Dynamics, 2015
- A comprehensive review of earthquake-induced building damage detection with remote sensing techniquesISPRS Journal of Photogrammetry and Remote Sensing, 2013
- What is a good evaluation measure for semantic segmentation?2013
- Terrestrial laser scanning intensity data applied to damage detection for historical buildingsJournal of Archaeological Science, 2010
- Urban building damage detection from very high resolution imagery using OCSVM and spatial featuresInternational Journal of Remote Sensing, 2010
- Building-damage detection using post-seismic high-resolution SAR satellite dataInternational Journal of Remote Sensing, 2010
- Detection and Animation of Damage using very High‐Resolution Satellite Data following the 2003 Bam, Iran, EarthquakeEarthquake Spectra, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002