HAG-Former: A Temporal-Polarimetric Relationship Inference Network From Local to Global
- 27 September 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Abstract
Multitemporal PolSAR data can provide a unique insight into the temporal scattering characteristics of targets and highlight their dynamic changes over time, therefore supporting improved classification performance. Constrained by the complexities of satellite orbit control technology and the challenges associated with time-series PolSAR data acquisition, most prevailing methodologies rely solely on single PolSAR image to tackle land coverage classification, inherently limiting their ability to generalize across diverse scenarios. To address this limitation, this work introduces a novel Hybrid Attention-GRU Transformer (HAG-Former) model, which harnesses the power of pixel-level temporal-polarimetric change analysis and captures the dynamic variations in polarization scattering properties, thereby enhancing classification robustness and versatility. In this approach, we seamlessly integrate a self-attention mechanism, Gated Recurrent Unit (GRU), and a transformer encoder to delve into pixel-level changes in polarimetric features. Initially, the self-attention mechanism pinpoints crucial classification-aiding features, bolstering their significance. The weighted features are then feed into the GRU model, enhancing local temporal-polarimetric relationship insights. These relationships, coupled with significant features from the self-attention mechanism, are subsequently processed by the transformer encoder, unraveling global information. Furthermore, we employ a label smoothing loss function during training, mitigating the impact of sample imbalance on classification accuracy. To validate the effectiveness of our proposed methodology, we evaluated it on two benchmark datasets. The results demonstrate a notable enhancement in classification performance, achieving an overall accuracy improvement of 2.21% and 1.79% over the state-of-the-art. The code is available in: https://github.com/Thomasakun/HAGFormer.Keywords
Funding Information
- National Natural Science Foundation of China (62302429)
- Open Foundation of Yunnan Key Laboratory of Media Convergence (220235203)
- Open Foundation of National Key Laboratory of Microwave Imaging Technology (AIRZB76-2023-000573)
This publication has 14 references indexed in Scilit:
- Crop Classification of Multitemporal PolSAR Based on 3-D Attention Module With ViTIEEE Geoscience and Remote Sensing Letters, 2023
- Local Window Attention Transformer for Polarimetric SAR Image ClassificationIEEE Geoscience and Remote Sensing Letters, 2023
- Multitemporal SAR and Polarimetric SAR Optimization and Classification: Reinterpreting Temporal CoherenceIEEE Transactions on Geoscience and Remote Sensing, 2022
- Fusion of Sentinel 1 and Alos Palsar Data to Separate Palm Oil Plantations from Forest Cover Mapping using Pauli Decomposition ApproachIEEE Latin America Transactions, 2022
- MDOAU-Net: A Lightweight and Robust Deep Learning Model for SAR Image Segmentation in Aquaculture Raft MonitoringIEEE Geoscience and Remote Sensing Letters, 2022
- N-BEATS neural network for mid-term electricity load forecastingApplied Energy, 2021
- Random Neighbor Pixel-Block-Based Deep Recurrent Learning for Polarimetric SAR Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2020
- Polarimetric SAR Time Series Change Analysis Over Agricultural AreasIEEE Transactions on Geoscience and Remote Sensing, 2020
- Full year crop monitoring and separability assessment with fully-polarimetric L-band UAVSAR: A case study in the Sacramento Valley, CaliforniaInternational Journal of Applied Earth Observation and Geoinformation, 2019
- Analysis, Evaluation, and Comparison of Polarimetric SAR Speckle Filtering TechniquesIEEE Transactions on Image Processing, 2014