A Nonlinear Extension of Principal Component Analysis for Clustering and Spatial Differentiation
- 1 December 1996
- journal article
- research article
- Published by Taylor & Francis in IIE Transactions
- Vol. 28 (12) , 1023-1028
Abstract
The limitations in the use of linear principal component analysis (PCA) for identifying morphological features of data sets are discussed. A nonlinear extension of PCA is introduced to provide this capability. It differs from ordinary PCA methods only in that the objective function involves a nonlinear transformation of the principal components. The procedure is shown to be closely related to the exploratory projection pursuit (EPP) algorithm proposed by Friedman (1987), and thus its usefulness in clustering and spatial differentiation applications is apparent. An efficient gradient ascent algorithm is proposed for implementation, based upon the use of a stochastic approximation. The inherent computational advantages in the suggested implementation over other EPP methods are evident, given that EPP methods require the estimation of a density function at every iteration. The nonlinear extension is evaluated by using several well-known datasets, including Fisher’s (1936) Iris data. An industrial application of the technique is also presented. Necessary conditions for convergence are shown.Keywords
This publication has 11 references indexed in Scilit:
- Multivariate Density Estimation1992
- Correlations in high dimensional or asymmetric data sets: Hebbian neuronal processingNeural Networks, 1991
- On Polynomial-Based Projection Indices for Exploratory Projection PursuitThe Annals of Statistics, 1989
- Exploratory Projection PursuitJournal of the American Statistical Association, 1987
- What is Projection Pursuit?Journal of the Royal Statistical Society Series A: Statistics in Society, 1987
- Projection PursuitThe Annals of Statistics, 1985
- Asymptotics of Graphical Projection PursuitThe Annals of Statistics, 1984
- Strong Convergence of a Stochastic Approximation AlgorithmThe Annals of Statistics, 1978
- A Projection Pursuit Algorithm for Exploratory Data AnalysisIEEE Transactions on Computers, 1974
- THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMSAnnals of Eugenics, 1936