Transform Dual-Branch Attention Net: Efficient Semantic Segmentation of Ultra-High-Resolution Remote Sensing Images
Open Access
- 5 February 2025
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 17 (3) , 540
Abstract
With the advancement of remote sensing technology, the acquisition of ultra-high-resolution remote sensing imagery has become a reality, opening up new possibilities for detailed research and applications of Earth’s surface. These ultra-high-resolution images, with spatial resolutions at the meter or sub-meter level and pixel counts exceeding 4 million, contain rich geometric and attribute details of surface objects. Their use significantly improves the accuracy of surface feature analysis. However, this also increases the computational resource demands of deep learning-driven semantic segmentation tasks. Therefore, we propose the Transform Dual-Branch Attention Net (TDBAN), which effectively integrates global and local information through a dual-branch design, enhancing image segmentation performance and reducing memory consumption. TDBAN leverages a cross-collaborative module (CCM) based on the Transform mechanism and a data-related learnable fusion module (DRLF) to achieve adaptive content processing. Experimental results show that TDBAN achieves mean intersection over union (mIoU) of 73.6% and 72.7% on DeepGlobe and Inria Aerial datasets, respectively, and surpasses existing models in memory efficiency, highlighting its superiority in handling ultra-high-resolution remote sensing images. This study not only advances the development of ultra-high-resolution remote sensing image segmentation technology, but also lays a solid foundation for further research in this field.Keywords
Funding Information
- Harbin Normal University (HSDBSCX2024-04, 41671064, TD2023D005)
- National Natural Science Foundation of China (HSDBSCX2024-04, 41671064, TD2023D005)
- Natural Science Foundation of Heilongjiang Province of China (HSDBSCX2024-04, 41671064, TD2023D005)
This publication has 54 references indexed in Scilit:
- Channel2DTransformer: A Multi-level Features Self-attention Fusion Module for Semantic SegmentationInternational Journal of Computational Intelligence Systems, 2024
- A multi-scale semantic feature fusion method for remote sensing crop classificationComputers and Electronics in Agriculture, 2024
- MultiTrans: Multi-branch transformer network for medical image segmentationComputer Methods and Programs in Biomedicine, 2024
- Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imageryInternational Journal of Remote Sensing, 2024
- A transformer-based approach empowered by a self-attention technique for semantic segmentation in remote sensingHeliyon, 2024
- Attention mechanisms in computer vision: A surveyComputational Visual Media, 2022
- Spatial self-attention network with self-attention distillation for fine-grained image recognitionJournal of Visual Communication and Image Representation, 2021
- BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic SegmentationInternational Journal of Computer Vision, 2021
- An attention-fused network for semantic segmentation of very-high-resolution remote sensing imageryISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Incorporating DeepLabv3+ and object-based image analysis for semantic segmentation of very high resolution remote sensing imagesInternational Journal of Digital Earth, 2020