MAPMaN: Multi‐Stage U‐Shaped Adaptive Pattern Matching Network for Semantic Segmentation of Remote Sensing Images
- 30 October 2023
- journal article
- research article
- Published by Wiley in Computer Graphics Forum
- Vol. 42 (7)
Abstract
Remote sensing images (RSIs) often possess obvious background noises, exhibit a multi‐scale phenomenon, and are characterized by complex scenes with ground objects in diversely spatial distribution pattern, bringing challenges to the corresponding semantic segmentation. CNN‐based methods can hardly address the diverse spatial distributions of ground objects, especially their compositional relationships, while Vision Transformers (ViTs) introduce background noises and have a quadratic time complexity due to dense global matrix multiplications. In this paper, we introduce Adaptive Pattern Matching (APM), a lightweight method for long‐range adaptive weight aggregation. Our APM obtains a set of pixels belonging to the same spatial distribution pattern of each pixel, and calculates the adaptive weights according to their compositional relationships. In addition, we design a tiny U‐shaped network using the APM as a module to address the large variance of scales of ground objects in RSIs. This network is embedded after each stage in a backbone network to establish a Multi‐stage U‐shaped Adaptive Pattern Matching Network (MAPMaN), for nested multi‐scale modeling of ground objects towards semantic segmentation of RSIs. Experiments on three datasets demonstrate that our MAPMaN can outperform the state‐of‐the‐art methods in common metrics. The code can be available athttps://github.com/INiid/MAPMaN.Keywords
Funding Information
- National Natural Science Foundation of China (62202421)
This publication has 30 references indexed in Scilit:
- Remote Sensing Image Mixed Noise Denoising with Noise Parameter EstimationSpringer Proceedings in Physics, 2020
- Panoptic Feature Pyramid Networks2019
- Deformable ConvNets V2: More Deformable, Better Results2019
- Dual Attention Network for Scene Segmentation2019
- CBAM: Convolutional Block Attention Module2018
- BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation2018
- Non-local Neural Networks2018
- Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network2017
- RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation2017
- Fully convolutional networks for semantic segmentation2015