DDCTNet: A Deformable and Dynamic Cross-Transformer Network for Road Extraction From High-Resolution Remote Sensing Images
Open Access
- 24 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-19
Abstract
Influenced by the concepts of deep learning, extracting roads from high-resolution remote sensing scenes has gained significant attention. However, there are still limitations in both metrics and practical application scenarios. To address these limitations, we proposed a deformable and dynamic cross-transformer network (DDCTNet), introducing three key innovations. Firstly, we employed a deformable and dynamic cross-transformer (DDCT) attention module to enhance the recovery of data and structural information during the feature map upsampling by providing rich semantic information of encoding stage to decoding stage from spatial and channel dimensions, respectively, which improved the quality of upsampling while preserving the inherent characteristics of the road. Secondly, we introduced a cross-scale strip-pooling axial attention (CSSA) between discontinuous encoding stages to alleviate the information loss caused by down-sampling and highlight the linear characteristic of roads by leveraging rich semantic information from previous stage, which not only considers road linear features in complex scenes but also reduces computational complexity. Finally, we designed an auxiliary head (AuxHead) by fusing the outputs from the latter three decoding modules to enhance the model’s generalization performance and convergence speed. Extensive experiments were conducted on three benchmark datasets. We also compared our DDCTNet with other classic road extraction models. The results show a noticeable improvement of 1%-5% across various evaluation metrics in three datasets. Additionally, the visualized results demonstrate that the proposed DDCTNet provides more accurate representations of real road scenes including distinguishing regions with high foreground-background similarity, addressing road occlusion, etc.Keywords
Funding Information
- National Natural Science Foundation of China (42101469)
- Aeronautical Science Foundation of China (2023Z034053001)
- State Key Laboratory of Geo-Information Engineering (SKLGIE2021-Z-4-1)
- Guangdong Basic and Applied Basic Research Foundation (2020A1515111158, 2023A1515111175)
- Fundamental Research Funds for the Central Universities (D5000210596)
This publication has 52 references indexed in Scilit:
- Leveraging topology for domain adaptive road segmentation in satellite and aerial imageryISPRS Journal of Photogrammetry and Remote Sensing, 2023
- An attention-based multiscale transformer network for remote sensing image change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2023
- SemiRoadExNet: A semi-supervised network for road extraction from remote sensing imagery via adversarial learningISPRS Journal of Photogrammetry and Remote Sensing, 2023
- RoadFormer: Pyramidal deformable vision transformers for road network extraction with remote sensing imagesInternational Journal of Applied Earth Observation and Geoinformation, 2022
- Extending nn-UNet for Brain Tumor Segmentation2022
- Multi-Task Learning and Multimodal Fusion for Road SegmentationIEEE Access, 2022
- A Global Context-aware and Batch-independent Network for road extraction from VHR satellite imageryISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Strip Pooling: Rethinking Spatial Pooling for Scene Parsing2020
- Improved Road Connectivity by Joint Learning of Orientation and Segmentation2019
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015