Collapsed Building Detection in High-Resolution Remote Sensing Images Based on Mutual Attention and Cost Sensitive Loss
- 20 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 20 (1545598X) , 1-5
Abstract
Detection of collapsed buildings based on high-resolution remote sensing images is of significance to post-earthquake emergency response and post-disaster reconstruction. In recent years, the UNet network architecture has been applied in detection of collapsed buildings to good effect. However, most existing methods directly fuse features of encoder and decoder subnets, which results in redundant or mutually exclusive information, thus weakening the capability of expressing details of the outline of collapsed buildings in detail. In addition, using these methods, the collapsed building samples in post-earthquake damage scenes are difficult to be acquired or account for a small proportion of the total detected image. These approaches indistinguishably processed the misclassified samples with different types in training processes, while ignoring the enhanced learning of collapsed building samples. Hence, a multimodule concatenation based on U-Shape network (MC-UNet) for detecting post-earthquake collapsed buildings based on a Mutual Attention Module (MAM) and Cost Sensitive loss (CS loss) was proposed. To begin, a MAM was designed in skip connections in UNet to fully utilize high-level and low-level feature information, as a result, feature expressive capability can be enhanced; on this basis, a novel CS loss was designed to force the model to focus more on the learning of collapsed building samples. Experiments on three groups of datasets (Mexico dataset, HTI dataset, and YSH dataset) about post-earthquake collapsed buildings indicate the scheme proposed remarkably outperforms some state-of-the-art algorithms.Keywords
Funding Information
- Post-doctoral Fund of Jiangsu Province (2021K013A)
- Science and Technology Program of Hebei (19275408D)
- 2020 Opening fund for Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering (2020SDSJ05)
- Construction fund for Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering (2019ZYYD007)
- 2022 Jiangsu Provincial Postgraduate Research and Practice Innovation Plan Project (SJCX22_0335)
This publication has 12 references indexed in Scilit:
- SNLRUX++ for Building Extraction From High-Resolution Remote Sensing ImagesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021
- Earthquake-Damaged Buildings Detection in Very High-Resolution Remote Sensing Images Based on Object Context and Boundary Enhanced LossRemote Sensing, 2021
- Detecting Demolished Buildings after a Natural Hazard Using High Resolution RGB Satellite Imagery and Modified U-Net Convolutional Neural NetworksRemote Sensing, 2021
- Coordinate Attention for Efficient Mobile Network Design2021
- A Novel Squeeze-and-Excitation W-Net for 2D and 3D Building Change Detection with Multi-Source and Multi-Feature Remote Sensing DataRemote Sensing, 2021
- Channel and spatial attention based deep object co-segmentationKnowledge-Based Systems, 2021
- Cross-Attentional Bracket-shaped Convolutional Network for semantic image segmentationInformation Sciences, 2020
- Building Extraction from Very High Resolution Aerial Imagery Using Joint Attention Deep Neural NetworkRemote Sensing, 2019
- Building Damage Detection via Superpixel-Based Belief Fusion of Space-Borne SAR and Optical ImagesIEEE Sensors Journal, 2019
- A novel multi-scale segmentation algorithm for high resolution remote sensing images based on wavelet transform and improved JSEG algorithmOptik, 2014