A Two-Branch Network Combined With Robust Principal Component Analysis for Hyperspectral Image Classification
- 14 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 18 (12) , 2147-2151
Abstract
Noise in hyperspectral images (HSIs) may degrade the HSI classification result. Robust principal component analysis (RPCA) is an excellent method to obtain low-rank (LR) representation of data and is widely used in image denoising and also in HSI classification. However, data are drawn as a union from multiple subspaces in HSIs, so LR subspace estimation (LRSE) is necessary when using RPCA, which is complicated and time-consuming. To solve this problem, this letter proposes a novel LR-based method for HSI classification called two-branch network combined with RPCA, which combines RPCA with a neural network. Specifically, both the LR component and the sparse component are preserved and used for feature extraction in two independent convolutional branches. This way, we can avoid information loss without using accurate LRSE. A concatenate operation and a pointwise convolution are then adopted to realize the feature fusion. Finally, fused features are constructed to indicate the ground truth of each pixel in the classification process. The proposed method constructs a convenient model for HSI classification by discarding the LRSE and combining denoising, feature extraction, feature fusion, and classification into an end-to-end network. The experimental results on three data sets demonstrate that the proposed method outperforms many state-of-the-art methods including ones based on LR representation and ones based on deep learning. In addition, it maintains good classification performance for the cases of small samples and class imbalance.Keywords
Funding Information
- National Natural Science Foundation of China (61672405, 61876141, U1701267, 61772399, 61773304, 61773300)
This publication has 18 references indexed in Scilit:
- Hyperspectral Image Restoration Using Low-Rank Tensor RecoveryIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017
- Going Deeper With Contextual CNN for Hyperspectral Image ClassificationIEEE Transactions on Image Processing, 2017
- Deep Fusion of Remote Sensing Data for Accurate ClassificationIEEE Geoscience and Remote Sensing Letters, 2017
- FusioNet: A two-stream convolutional neural network for urban scene classification using PolSAR and hyperspectral data2017
- Hyperspectral Image Classification by Exploring Low-Rank Property in Spectral or/and Spatial DomainIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017
- Low-Rank Subspace Representation for Estimating the Number of Signal Subspaces in Hyperspectral ImageryIEEE Transactions on Geoscience and Remote Sensing, 2015
- Sensor noise informed representation of hyperspectral data, with benefits for image storage and processingOptics Express, 2011
- Robust principal component analysis?Journal of the ACM, 2011
- Image Denoising by Sparse 3-D Transform-Domain Collaborative FilteringIEEE Transactions on Image Processing, 2007
- Composite Kernels for Hyperspectral Image ClassificationIEEE Geoscience and Remote Sensing Letters, 2006