Howard Hua Yang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Howard Hua Yang has a total of 1 co-authors. Here are the top co-authors by number of shared publications:
Shun-Ichi Amari
Laboratory for Information Synthesis, RIKEN Brain Science Institute, Saitama 351-01, Japan
1 shared publication
Latest Publications
- 1 November 1998
- Published by MIT Press in Neural Computation
- Vol. 10 (8) , 2137-2157
Complexity Issues in Natural Gradient Descent Method for Training Multilayer Perceptrons
The natural gradient descent method is applied to train an n-m-1 multilayer perceptron. Based on an efficient scheme to represent the Fisher information matrix for an n-m-1 stochastic multilayer perceptron, a new algorithm is proposed to calculate the natural gradient without inverting the Fisher information matrix explicitly. When the input dimension n is much larger than the number of hidden neurons m, the time complexity of computing the natural gradient is O(n).
- 1 November 1998
- Published by MIT Press in Neural Computation
- Vol. 10 (8) , 2137-2157
Complexity Issues in Natural Gradient Descent Method for Training Multilayer Perceptrons
The natural gradient descent method is applied to train an n-m-1 multilayer perceptron. Based on an efficient scheme to represent the Fisher information matrix for an n-m-1 stochastic multilayer perceptron, a new algorithm is proposed to calculate the natural gradient without inverting the Fisher information matrix explicitly. When the input dimension n is much larger than the number of hidden neurons m, the time complexity of computing the natural gradient is O(n).