Content-driven Magnitude-Derivative Spectrum Complementary Learning for Hyperspectral Image Classification
Authors:
- Huiyan BaiHBHuiyan Bai
- Tingfa XuTXTingfa Xu
- Huan ChenHCHuan Chen
- Peifu LiuPLPeifu Liu
- Jianan LiJLJianan Li
Preprint
Abstract
Extracting discriminative information from complex spectral details in hyperspectral image (HSI) for HSI classification is pivotal. While current prevailing methods rely on spectral magnitude features, they could cause confusion in certain classes, resulting in misclassification and decreased accuracy. We find that the derivative spectrum proves more adept at capturing concealed information, thereby offering a distinct advantage in separating these confusion classes. Leveraging the complementarity between spectral magnitude and derivative features, we propose a Content-driven Spectrum Complementary Network based on Magnitude-Derivative Dual Encoder, employing these two features as combined inputs. To fully utilize their complementary information, we raise a Content-adaptive Point-wise Fusion Module, enabling adaptive fusion of dual-encoder features in a point-wise selective manner, contingent upon feature representation. To preserve a rich source of complementary information while extracting more distinguishable features, we introduce a Hybrid Disparity-enhancing Loss that enhances the differential expression of the features from the two branches and increases the inter-class distance. As a result, our method achieves state-of-the-art results on the extensive WHU-OHS dataset and eight other benchmark datasets.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- A multi-task learning method for extraction of newly constructed areas based on bi-temporal hyperspectral imagesISPRS Journal of Photogrammetry and Remote Sensing, 2024
- Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networksRemote Sensing of Environment, 2023
- WHU-OHS: A benchmark dataset for large-scale Hersepctral Image classificationInternational Journal of Applied Earth Observation and Geoinformation, 2022
- Multispectral and hyperspectral image fusion in remote sensing: A surveyInformation Fusion, 2022
- CANet: Co-attention network for RGB-D semantic segmentationPattern Recognition, 2022
- WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRFRemote Sensing of Environment, 2020
- Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Deep Learning-Based Classification of Hyperspectral DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- Spectral Derivative Features for Classification of Hyperspectral Remote Sensing Images: Experimental EvaluationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2013
- A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural MeasureIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2008