CCTNet: CNN and Cross-Shaped Transformer Hybrid Network for Remote Sensing Image Semantic Segmentation
Open Access
- 28 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 19986-19997
Abstract
Deep learning methods have achieved great success in the field of remote sensing image segmentation in recent years, but building a lightweight segmentation model with comprehensive local and global feature extraction capabilities remains a challenging task. In this paper, we propose a CNN and cross-shaped transformer hybrid network (CCTNet) for semantic segmentation of high-resolution remote sensing images. This model follows an encoder-decoder structure. It employs ResNet18 as an encoder to extract hierarchical feature information, and constructs a transformer decoder based on efficient cross-shaped self-attention (CSSA) to fully model local and global feature information and achieve lightweighting of the network. Moreover, the transformer block introduces a mixed-scale convolutional feedforward network (MCFFN) to further enhance multi-scale information extraction. Furthermore, a simplified and efficient feature aggregation module (FAM) is leveraged to gradually aggregate local and global information at different stages. Extensive comparison experiments on the ISPRS Vaihingen and Potsdam datasets reveal that our method obtains superior performance compared with state-of-the-art lightweight methods.Keywords
Funding Information
- Changsha Municipal Natural Science Foundation (kq2208236)
This publication has 49 references indexed in Scilit:
- UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imageryISPRS Journal of Photogrammetry and Remote Sensing, 2022
- A2-FPN for semantic segmentation of fine-resolution remotely sensed imagesInternational Journal of Remote Sensing, 2022
- Land cover classification from remote sensing images based on multi-scale fully convolutional networkGeo-spatial Information Science, 2022
- ABCNet: Attentive bilateral contextual network for efficient semantic segmentation of Fine-Resolution remotely sensed imageryISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Deep semantic segmentation of natural and medical images: a reviewArtificial Intelligence Review, 2020
- Examining the impacts of future land use/land cover changes on climate in Punjab province, Pakistan: implications for environmental sustainability and economic growthEnvironmental Science and Pollution Research, 2020
- Problems of encoder-decoder frameworks for high-resolution remote sensing image segmentation: Structural stereotype and insufficient learningNeurocomputing, 2019
- Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learningISPRS Journal of Photogrammetry and Remote Sensing, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Random forest classifier for remote sensing classificationInternational Journal of Remote Sensing, 2005