Dimensionality Reduction via Regression in Hyperspectral Imagery
Authors:
- Valero LaparraVLValero Laparra
- Jesus MaloJMJesus Malo
- Gustau Camps-VallsGCGustau Camps-Valls
Preprint
Abstract
This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead of linear features. DRR identifies the nonlinear features through multivariate regression to ensure the reduction in redundancy between he PCA coefficients, the reduction of the variance of the scores, and the reduction in the reconstruction error. More importantly, unlike other nonlinear dimensionality reduction methods, the invertibility, volume-preservation, and straightforward out-of-sample extension, makes DRR interpretable and easy to apply. The properties of DRR enable learning a more broader class of data manifolds than the recently proposed Non-linear Principal Components Analysis (NLPCA) and Principal Polynomial Analysis (PPA). We illustrate the performance of the representation in reducing the dimensionality of remote sensing data. In particular, we tackle two common problems: processing very high dimensional spectral information such as in hyperspectral image sounding data, and dealing with spatial-spectral image patches of multispectral images. Both settings pose collinearity and ill-determination problems. Evaluation of the expressive power of the features is assessed in terms of truncation error, estimating atmospheric variables, and surface land cover classification error. Results show that DRR outperforms linear PCA and recently proposed invertible extensions based on neural networks (NLPCA) and univariate regressions (PPA).Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Kernel Multivariate Analysis Framework for Supervised Subspace Learning: A Tutorial on Linear and Kernel Multivariate MethodsIEEE Signal Processing Magazine, 2013
- Nonlinear data description with Principal Polynomial Analysis2012
- Validation of Nonlinear PCANeural Processing Letters, 2012
- Recent advances in techniques for hyperspectral image processingRemote Sensing of Environment, 2009
- Assimilation of IASI at the Met Office and assessment of its impact through observing system experimentsQuarterly Journal of the Royal Meteorological Society, 2009
- Nonlinear Principal Component Analysis: Neural Network Models and Applications2008
- V1 non-linear properties emerge from local-to-global non-linear ICANetwork: Computation in Neural Systems, 2006
- Kernel Methods for Pattern Analysis2004
- Another Look at Principal Curves and SurfacesJournal of Multivariate Analysis, 2001
- Nonlinear principal component analysis using autoassociative neural networksAIChE Journal, 1991