Hyperspectral Remote Sensing Images Deep Feature Extraction Based on Mixed Feature and Convolutional Neural Networks
Open Access
- 2 July 2021
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 13 (13) , 2599
Abstract
To achieve effective deep fusion features for improving the classification accuracy of hyperspectral remote sensing images (HRSIs), a pixel frequency spectrum feature is presented and introduced to convolutional neural networks (CNNs). Firstly, the fast Fourier transform is performed on each spectral pixel to obtain the amplitude spectrum, i.e., the pixel frequency spectrum feature. Then, the obtained pixel frequency spectrum is combined with the spectral pixel to form a mixed feature, i.e., spectral and frequency spectrum mixed feature (SFMF). Several multi-branch CNNs fed with pixel frequency spectrum, SFMF, spectral pixel, and spatial features are designed for extracting deep fusion features. A pre-learning strategy, i.e., basic single branch CNNs are used to pre-learn the weights of a multi-branch CNN, is also presented for improving the network convergence speed and avoiding the network from getting into a locally optimal solution to a certain extent. And after reducing the dimensionality of SFMF by principal component analysis (PCA), a 3-dimensionality (3-D) CNN is also designed to further extract the joint spatial-SFMF feature. The experimental results of three real HRSIs show that adding the presented frequency spectrum feature into CNNs can achieve better recognition results, which in turn proves that the presented multi-branch CNNs can obtain the deep fusion features with more discriminant information.Keywords
Funding Information
- National Natural Science Foundation of China (No. 61672405, No. 62077038)
- Natural Science Foundation of Shaanxi Province of China (No. 2021JM-459, No. 2018JM4018)
- Shaanxi Province Key Research and Development Project (No. 2021GY-280)
This publication has 27 references indexed in Scilit:
- DF-SSD: a deep convolutional neural network-based embedded lightweight object detection framework for remote sensing imageryJournal of Applied Remote Sensing, 2020
- Hyperspectral remote sensing image feature extraction based on spectral clustering and subclass discriminant analysisRemote Sensing Letters, 2019
- A Convolutional Neural Network Classifier Identifies Tree Species in Mixed-Conifer Forest from Hyperspectral ImageryRemote Sensing, 2019
- Multiscale Spatial-Spectral Convolutional Network with Image-Based Framework for Hyperspectral Imagery ClassificationRemote Sensing, 2019
- Hyperspectral Image Classification With Global–Local Discriminant Analysis and Spatial–Spectral ContextIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018
- Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning ApproachIEEE Transactions on Geoscience and Remote Sensing, 2016
- Spectral–spatial classification of hyperspectral images using deep convolutional neural networksRemote Sensing Letters, 2015
- Deep Convolutional Neural Networks for Hyperspectral Image ClassificationJournal of Sensors, 2015
- Hyperspectral dimension reduction using global and local information based linear discriminant analysisISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2014
- Progress in Hyperspectral Remote Sensing Science and Technology in China Over the Past Three DecadesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2013