A Globally Convergent MC Algorithm With an Adaptive Learning Rate
Authors:
- 30 December 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 23 (2) , 359-365
Abstract
This brief deals with the problem of minor component analysis (MCA). Artificial neural networks can be exploited to achieve the task of MCA. Recent research works show that convergence of neural networks based MCA algorithms can be guaranteed if the learning rates are less than certain thresholds. However, the computation of these thresholds needs information about the eigenvalues of the autocorrelation matrix of data set, which is unavailable in online extraction of minor component from input data stream. In this correspondence, we introduce an adaptive learning rate into the OJAn MCA algorithm, such that its convergence condition does not depend on any unobtainable information, and can be easily satisfied in practical applications.Keywords
This publication has 20 references indexed in Scilit:
- A unified learning algorithm to extract principal and minor componentsDigital Signal Processing, 2009
- A neural networks learning algorithm for minor component analysis and its convergence analysisNeurocomputing, 2008
- Dynamics of Generalized PCA and MCA Learning AlgorithmsIEEE Transactions on Neural Networks, 2007
- Convergence analysis of the OJAn MCA learning algorithm by the deterministic discrete time methodTheoretical Computer Science, 2007
- Convergence Analysis of a Deterministic Discrete Time System of Oja's PCA Learning AlgorithmIEEE Transactions on Neural Networks, 2005
- Global convergence analysis of a self-stabilizing MCA learning algorithmNeurocomputing, 2005
- On the discrete-time dynamics of a PCA learning algorithmNeurocomputing, 2003
- On the discrete-time dynamics of the basic Hebbian neural network nodeIEEE Transactions on Neural Networks, 2002
- Adaptive Principal component EXtraction (APEX) and applicationsIEEE Transactions on Signal Processing, 1994
- Simplified neuron model as a principal component analyzerJournal of Mathematical Biology, 1982