Luyi Qiu

Most deep-learning methods that achieve high segmentation accuracy require deep network architectures that are too heavy and complex to run on embedded devices with limited storage and memory space. To address this issue, this letter proposes an efficient generative adversarial transformer (GATrans) for achieving high-precision semantic segmentation while maintaining an extremely efficient size. The framework utilizes a global transformer network (GTNet) as the generator, efficiently extracting multilevel features through residual connections. GTNet employs global transformer blocks with progressively linear computational complexity to reassign global features based on a learnable similarity function. To focus on object- and pixel-level information, the GATrans optimizes the objective function by combining structural similarity losses. We validate the effectiveness of our approach through extensive experiments on the Vaihingen dataset, achieving an average $F1$ score of 90.17% and an overall accuracy (OA) of 91.92%. Codes are available at https://github.com/qiuluyi/GATrans .

Remote sensing change detection between bi-temporal images receives growing concentration from researchers. However, comparing two bi-temporal images for detecting changes is challenging, as they demonstrate different appearances. In this paper, we propose a dual attentive generative adversarial network for achieving very high-resolution remote sensing image change detection tasks, which regards the detection model as a generator and attains the optimal weights of the detection model without increasing the parameters of the detection model through generative-adversarial strategy, boosting the spatial contiguity of predictions. Moreover, We design a multi-level feature extractor for effectively fusing multi-level features, which adopts the pre-trained model to extract multi-level features from bi-temporal images and introduces aggregate connections to fuse them. To strengthen the identification of multi-scale objects, we propose a multi-scale adaptive fusion module to adaptively fuse multi-scale features through various receptive fields and design a context refinement module to explore contextual dependencies. Moreover, the DAGAN framework utilizes the 4-layer convolution network as a discriminator to identify whether the synthetic image is fake or real. Extensive experiments represent that the DAGAN framework has better performance with 85.01% mean IoU and 91.48% mean F1 score than advanced methods on the LEVIR dataset.

Road extraction from remote sensing images in very high resolution is important for autonomous driving and road planning. Compared with large-scale objects, roads are smaller, winding, and likely to be covered by buildings’ shadows, causing deep convolutional neural networks (DCNNs) to be difficult to identify roads. The paper proposes a semantics-geometry framework (SGNet) with a two-branch backbone, i.e., semantics-dominant branch and geometry-dominant branch. The semantics-dominant branch inputs images to predict dense semantic features, and the geometry-dominant branch takes images to generate sparse boundary features. Then, dense semantic features and boundary details generated by two branches are adaptively fused. Further, by utilizing affinity between neighborhood pixels, a feature refinement module is proposed to refine textures and road details. We evaluate the SGNet on the Ottawa road dataset. Experiments show that the SGNet outperforms other competitors on the road extraction task. Codes is available at https://github.com/qiuluyi/SGNet.

Recently, deep learning has been widely used in the segmentation tasks of remote sensing images. However, the existing deep learning method most focus on local contextual information and has limited field of perception, which makes it difficult to capture the long-range contextual feature of objects at large scales form very-high-resolution (VHR) images. In this paper, we present a novel Local–global Framework consisting of the dual-source fusion network and local–global transformer modules, which efficiently utilize features extracted from multiple sources and fully capture features of local and global regions. The dual-source fusion network is an encoder designed to extract features from multiple sources such as spectra, synthetic aperture radar, and elevations, which selective fuse features from multiple sources and reduce the interference of redundant features. The local–global transformer module is proposed to capture fine-grained local features and coarse-grained global features, which enables the framework to focus on recognizing multiple-scale objects from the local and global regions. Moreover, we propose a pixelwise contrastive loss, which could encourage that the prediction is pulled closer to the ground truth. The Local–global Framework achieves state-of-the-art performance with 90.45% mean f1 score on the ISPRS Vaihingen dataset and 93.20% mean f1 score on the ISPRS Potsdam dataset.