Multilayer associative neural networks (MANN's): storage capacity versus perfect recall
Author:
- 1 January 1994
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 5 (5) , 812-822
Abstract
The objective of this paper is to to resolve important issues in artificial neural nets-exact recall and capacity in multilayer associative memories. These problems have imposed restrictions on coding strategies. We propose the following triple-layered hybrid neural network: the first synapse is a one-shot associative memory using the modified Kohonen's adaptive learning algorithm with arbitrary input patterns; the second one is Kosko's bidirectional associative memory consisting of orthogonal input/output basis vectors such as Walsh series satisfying the strict continuity condition; and finally, the third one is a simple one-shot associative memory with arbitrary output images. A mathematical framework based on the relationship between energy local minima (capacity of the neural net) and noise-free recall is established. The robust capacity conditions of this multilayer associative neural network that lead to forming the local minima of the energy function at the exact training pairs are derived. The chosen strategy not only maximizes the total number of stored images but also completely relaxes any code-dependent conditions of the learning pairs.Keywords
This publication has 9 references indexed in Scilit:
- Two coding strategies for bidirectional associative memoryIEEE Transactions on Neural Networks, 1990
- 30 years of adaptive neural networks: perceptron, Madaline, and backpropagationProceedings of the IEEE, 1990
- Stability and adaptation in artificial neural systemsPhysical Review A, 1989
- Bidirectional associative memoriesIEEE Transactions on Systems, Man, and Cybernetics, 1988
- A BAM with increased information storage capacity1988
- Adaptive bidirectional associative memoriesApplied Optics, 1987
- The capacity of the Hopfield associative memoryIEEE Transactions on Information Theory, 1987
- Parallel Distributed Processing1986
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences of the United States of America, 1982