Transformers for aerial images semantic segmentation of natural disaster-impacted areas in natural disaster assessment
Open Access
- 1 April 2025
- journal article
- Published by Institute of Advanced Engineering and Science in Bulletin of Electrical Engineering and Informatics
- Vol. 14 (2) , 1391-1406
Abstract
Aerial image segmentation of natural disaster-impacted areas and detailed and automatic natural disaster assessment are the main focus of this study. Detecting and recognizing objects on aerial images of areas impacted by natural disasters and assessing natural disaster-impacted areas are still difficult problems. To solve these problems, this study utilizes four of the latest transformer-based semantic segmentation network models, bidirectional encoder representation from image transformers (BEIT), dense prediction transformer (DPT), OneFormer, and SegFormer, and proposes a detailed and automatic natural disaster assessment of the segmented image. The SegFormer model achieved the first-best result, and the OneFormer model achieved the second-best result. The SegFormer model outperformed OneFormer by 1.58% higher for the mean accuracy value and 4.28% for the mean intersection over union (mIoU) value. All receiver operating characteristics (ROC) curves have mean area under curve (AUC) values above 0.9, which means that the SegFormer model performs well in generating semantic segmentation images. The fuzzy c-means (FCM) clustering algorithm performed well and could automatically cluster the natural disaster assessments into four categories. This study has produced semantic segmentation of aerial images of areas impacted by natural disasters and natural disaster assessments, which can be used in natural disaster management systems.Keywords
This publication has 32 references indexed in Scilit:
- DAM-Net: Flood detection from SAR imagery using differential attention metric-based vision transformersISPRS Journal of Photogrammetry and Remote Sensing, 2024
- Self-supervised Learning for Building Damage Assessment from Large-Scale xBD Satellite Imagery Benchmark Datasets2022
- FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene UnderstandingIEEE Access, 2021
- Deep learning-based aerial image segmentation with open data for disaster impact assessmentNeurocomputing, 2021
- Efficient image segmentation and implementation of K-means clusteringMaterials Today: Proceedings, 2021
- Local segmentation of images using an improved fuzzy C-means clustering algorithm based on self-adaptive dictionary learningApplied Soft Computing, 2020
- Student Engagement Level in an e-Learning Environment: Clustering Using K-meansAmerican Journal of Distance Education, 2020
- Rice yield estimation based on K-means clustering with graph-cut segmentation using low-altitude UAV imagesBiosystems Engineering, 2019
- Semantic Understanding of Scenes Through the ADE20K DatasetInternational Journal of Computer Vision, 2018
- Fuzzy c-Means Clustering Strategies: A Review of Distance Measures2018