AIS-PVT: Long-Time AIS Data Assisted Pyramid Vision Transformer for Sea-Land Segmentation in Dual-Polarization SAR Imagery
- 26 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-12
Abstract
Traditional Synthetic Aperture Radar (SAR) image sea-land segmentation algorithms overlook the ship distribution priori-information provided by the Automatic Identification System (AIS) data, resulting in poor segmentation performance in complex environments such as ports, marine wetlands, beaches, and other sea-land boundaries. To address the above issues, this paper comprehensively uses dual-polarization (VV and VH) SAR images and AIS data as the data source, and it specifically proposes a novel Pyramid Vision Transformer (PVT) assisted by the long-time AIS data (AIS-PVT) for sea-land segmentation. AIS-PVT is the first attempt to integrate the ship distribution density priori-information, provided by the long-time AIS data, into PVT network, thus the multi-scale features of the sea and land can be better distinguished. In the decoding stage, we design a Feature Filtering Module (FFM). It aggregates features separately along two spatial directions from the skip connections, enhancing the representation of objects of interest while reducing the influence of redundant information. Furthermore, we develop a boundary-pixel-aware function to steer the model training process, allowing AIS-PVT to concentrate more on the neighborhood information of boundary pixels. Importantly, the AIS-PVT method captures global multi-scale information and enhances the model’s data fusion capability. The conclusive experimental results demonstrate the superior performance of our approach in sea-land segmentation tasks, outperforming other state-of-the-art techniques.Keywords
Funding Information
- National Natural Science Foundation of China (62471171, 62071164, 62001155)
- Hefei Municipal Natural Science Foundation (2022001)
- Fundamental Research Funds for the Central Universities (PA2023IISL0098)
This publication has 47 references indexed in Scilit:
- PVT v2: Improved baselines with pyramid vision transformerComputational Visual Media, 2022
- Application of deep learning models to detect coastlines and shorelinesJournal of Environmental Management, 2022
- Automatic coastline extraction through enhanced sea-land segmentation by modifying Standard U-NetInternational Journal of Applied Earth Observation and Geoinformation, 2022
- BS-Net: Using Joint-Learning Boundary and Segmentation Network for Coastline Extraction from Remote Sensing ImagesRemote Sensing Letters, 2021
- Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions2021
- Phase spectrum based automatic ship detection in synthetic aperture radar imagesJournal of Ocean Engineering and Science, 2021
- An ensemble deep learning based shoreline segmentation approach (WaterNet) from Landsat 8 OLI imagesAdvances In Space Research, 2021
- Multi-Pol Sar Data Fusion for Coastline Extraction by Neural Networks Chaining2020
- A novel approach to use semantic segmentation based deep learning networks to classify multi-temporal SAR dataGeocarto International, 2020
- Sea-Land Segmentation Using Deep Learning Techniques for Landsat-8 OLI ImageryMarine Geodesy, 2020