Probabilistic principal component analysis based on JoyStick Probability Selector
- 1 June 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1414-1421
Abstract
Principal component analysis (PCA) is a commonly applied technique for data analysis and processing, e.g. compression or clustering. In this paper we propose a probabilistic PCA model based on the Born rule. In off-line realization it can be seen as a successive optimization problem. In the on-line realization it will be solved by introduction of two different time scales. It will be shown that recently proposed time oriented hierarchical method, used for realization of biologically plausible PCA neural networks, represents a special case of the proposed model. The proposed model gives a general framework for creating different PCA realizations/algorithms. A particular realization can optimize locality of calculation, convergence speed, preciseness or some other parameter of interest. We will present some experimental results to illustrate effectiveness of the proposed model.Keywords
This publication has 19 references indexed in Scilit:
- A Multipurpose Linear Component Analysis Method Based on Modulated Hebb-Oja Learning RuleIEEE Signal Processing Letters, 2008
- Tensor based image segmentation2008
- Modulated Hebb–Oja Learning Rule—A Method for Principal Subspace AnalysisIEEE Transactions on Neural Networks, 2006
- Neural Learning on Grassman/Stiefel Principal/Minor Submanifold2005
- TIME-ORIENTED HIERARCHICAL METHOD FOR COMPUTATION OF PRINCIPAL COMPONENTS USING SUBSPACE LEARNING ALGORITHMInternational Journal of Neural Systems, 2004
- Probabilistic Principal Component AnalysisJournal of the Royal Statistical Society Series B: Statistical Methodology, 1999
- A class of neural networks for independent component analysisIEEE Transactions on Neural Networks, 1997
- Hamiltonian evolution for the hybrid Monte Carlo algorithmNuclear Physics B - Proceedings Supplements, 1992
- NEURAL NETWORKS, PRINCIPAL COMPONENTS, AND SUBSPACESInternational Journal of Neural Systems, 1989
- Analysis of a complex of statistical variables into principal components.Journal of Educational Psychology, 1933