Adaptive Multi-Feature Fusion Graph Convolutional Network for Hyperspectral Image Classification
Open Access
- 24 November 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (23) , 5483
Abstract
Graph convolutional networks (GCNs) are a promising approach for addressing the necessity for long-range information in hyperspectral image (HSI) classification. Researchers have attempted to develop classification methods that combine strong generalizations with effective classification. However, the current HSI classification methods based on GCN present two main challenges. First, they overlook the multi-view features inherent in HSIs, whereas multi-view information interacts with each other to facilitate classification tasks. Second, many algorithms perform a rudimentary fusion of extracted features, which can result in information redundancy and conflicts. To address these challenges and exploit the strengths of multiple features, this paper introduces an adaptive multi-feature fusion GCN (AMF-GCN) for HSI classification. Initially, the AMF-GCN algorithm extracts spectral and textural features from the HSIs and combines them to create fusion features. Subsequently, these three features are employed to construct separate images, which are then processed individually using multi-branch GCNs. The AMG-GCN aggregates node information and utilizes an attention-based feature fusion method to selectively incorporate valuable features. We evaluated the model on three widely used HSI datasets, i.e., Pavia University, Salinas, and Houston-2013, and achieved accuracies of 97.45%, 98.03%, and 93.02%, respectively. Extensive experimental results show that the classification performance of the AMF-GCN on benchmark HSI datasets is comparable to those of state-of-the-art methods.Keywords
Funding Information
- College Students’ Innovative Entrepreneurial Training Plan Program (202310491003, CUGDCJJ202227)
- Fundamental Research Founds for National University, China University of Geosciences (Wuhan) (202310491003, CUGDCJJ202227)
This publication has 63 references indexed in Scilit:
- Spectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-EncoderIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2016
- Nonlinear Multiple Kernel Learning With Multiple-Structure-Element Extended Morphological Profiles for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2016
- Deep supervised learning for hyperspectral data classification through convolutional neural networks2015
- Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief NetworkIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Deep Learning-Based Classification of Hyperspectral DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- Wavelets on graphs via spectral graph theoryApplied and Computational Harmonic Analysis, 2011
- Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2010
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Texture discrimination with multidimensional distributions of signed gray-level differencesPattern Recognition, 2001
- Identification and mapping of minerals in drill core using hyperspectral image analysis of infrared reflectance spectraInternational Journal of Remote Sensing, 1996