Products of Gaussians and Probabilistic Minor Component Analysis
- 1 May 2002
- journal article
- Published by MIT Press in Neural Computation
- Vol. 14 (5) , 1169-1182
Abstract
Recently, Hinton introduced the products of experts architecture for density estimation, where individual expert probabilities are multiplied and renormalized. We consider products of gaussian “pancakes” equally elongated in all directions except one and prove that the maximum likelihood solution for the model gives rise to a minor component analysis solution. We also discuss the covariance structure of sums and products of gaussian pancakes or one-factor probabilistic principal component analysis models.Keywords
This publication has 4 references indexed in Scilit:
- Probabilistic Principal Component AnalysisJournal of the Royal Statistical Society Series B: Statistical Methodology, 1999
- A scaled conjugate gradient algorithm for fast supervised learningNeural Networks, 1993
- Principal components, minor components, and linear neural networksNeural Networks, 1992
- NEURAL NETS FOR DUAL SUBSPACE PATTERN RECOGNITION METHODInternational Journal of Neural Systems, 1991