Content-Driven Magnitude-Derivative Spectrum Complementary Learning for Hyperspectral Image Classification
- 29 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-14
Abstract
Extracting discriminative information from complex spectral details in hyperspectral image (HSI) for HSI classification is pivotal. While current prevailing methods rely on spectral magnitude features, they could cause confusion in certain classes, resulting in misclassification and decreased accuracy. We find that the derivative spectrum proves more adept at capturing concealed information, thereby offering a distinct advantage in separating these confusion classes. Leveraging the complementarity between spectral magnitude and derivative features, we propose a Content-driven Spectrum Complementary Network based on Magnitude-Derivative Dual Encoder, employing these two features as combined inputs. To fully utilize their complementary information, we raise a Content-adaptive Point-wise Fusion Module, enabling adaptive fusion of dual-encoder features in a point-wise selective manner, contingent upon feature representation. To preserve a rich source of complementary information while extracting more distinguishable features, we introduce a Hybrid Disparity-enhancing Loss that enhances the differential expression of the features from the two branches and increases the inter-class distance. As a result, our method achieves state-of-the-art results on the extensive WHU-OHS dataset and eight other benchmark datasets.Keywords
All Related Versions
Funding Information
- Young Elite Scientist Sponsorship Program of China Association for Science and Technology (No. YESS20220448)
- Young Elite Scientist Sponsorship Program of Beijing Association for Science and Technology (No. BYESS2022167)
- National Natural Science Foundation of China (No. 62101032)
This publication has 45 references indexed in Scilit:
- A multi-task learning method for extraction of newly constructed areas based on bi-temporal hyperspectral imagesISPRS Journal of Photogrammetry and Remote Sensing, 2024
- Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networksRemote Sensing of Environment, 2023
- WHU-OHS: A benchmark dataset for large-scale Hersepctral Image classificationInternational Journal of Applied Earth Observation and Geoinformation, 2022
- Multispectral and hyperspectral image fusion in remote sensing: A surveyInformation Fusion, 2022
- CANet: Co-attention network for RGB-D semantic segmentationPattern Recognition, 2022
- WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets and classifier for precise crop identification based on deep convolutional neural network with CRFRemote Sensing of Environment, 2020
- DANet: Divergent Activation for Weakly Supervised Object Localization2019
- Non-local Neural Networks2018
- Spectral Derivative Features for Classification of Hyperspectral Remote Sensing Images: Experimental EvaluationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2013
- A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural MeasureIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2008