BCTNet: Bi-Branch Cross-Fusion Transformer for Building Footprint Extraction
- 29 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 61 (01962892) , 1-14
Abstract
Building footprint extraction in remote sensing remains challenging due to the diverse appearances of buildings and confusing scenarios. Recently, researchers have revealed that both the globality and locality are vitally important in building footprint extraction tasks and proposed to incorporate the local context and global long-range dependency in the segmentation models. However, the inadequate integration of the globality and locality still leads to incomplete, fake or missing extraction results. To alleviate these problems, a novel segmentation method named Bi-branch Cross-fusion Transformer Network (BCTNet) is proposed in this study. Two parallel branches of the convolutional encoder branch (CB) and the transformer encoder branch (TB) are designed to extract multi-scale feature maps. A concatenation-then-cross-fusion transformer block (CCTB) is put forward to integrate the locality from the CB and globality from the TB in a cross-fusion way at each stage of the encoding process. Then, an adaptive gating module (AGM) is proposed to gate the feature maps from the CCTB to strengthen the important features while suppressing the irrelevant interference information. After that, the segmentation results can be obtained through a simple decoding process. Comprehensive experiments on two benchmark datasets demonstrate that the proposed BCTNet can achieve superior performance compared to the current state-of-the-art (SOTA) segmentation methods.Keywords
Funding Information
- National Natural Science Foundation of China (61901454, 61971404)
- Youth Innovation Promotion Association of the Chinese Academy of Sciences (2019168)
This publication has 63 references indexed in Scilit:
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- A Morphological Building Detection Framework for High-Resolution Optical Imagery Over Urban AreasIEEE Geoscience and Remote Sensing Letters, 2016
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Orientation-selective building detection in aerial imagesISPRS Journal of Photogrammetry and Remote Sensing, 2015
- Fully convolutional networks for semantic segmentation2015
- An Efficient Approach for Automatic Rectangular Building Extraction From Very High Resolution Optical Satellite ImageryIEEE Geoscience and Remote Sensing Letters, 2014
- Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contoursInternational Journal of Applied Earth Observation and Geoinformation, 2010
- Urban-Area and Building Detection Using SIFT Keypoints and Graph TheoryIEEE Transactions on Geoscience and Remote Sensing, 2009