A hierarchical neural network model for associative memory
Author:
- 1 April 1984
- journal article
- research article
- Published by Springer Nature in Biological Cybernetics
- Vol. 50 (2) , 105-113
Abstract
A hierarchical neural network model with feedback interconnections, which has the function of associative memory and the ability to recognize patterns, is proposed. The model consists of a hierarchical multi-layered network to which efferent connections are added, so as to make positive feedback loops in pairs with afferent connections. The cell-layer at the initial stage of the network is the input layer which receives the stimulus input and at the same time works as an output layer for associative recall. The deepest layer is the output layer for pattern-recognition. Pattern-recognition is performed hierarchically by integrating information by converging afferent paths in the network. For the purpose of associative recall, the integrated information is again distributed to lower-order cells by diverging efferent paths. These two operations progress simultaneously in the network. If a fragment of a training pattern is presented to the network which has completed its self-organization, the entire pattern will gradually be recalled in the initial layer. If a stimulus consisting of a number of training patterns superposed is presented, one pattern gradually becomes predominant in the recalled output after competition between the patterns, and the others disappear. At about the same time when the recalled pattern reaches a steady state in he initial layer, in the deepest layer of the network, a response is elicited from the cell corresponding to the category of the finally-recalled pattern. Once a steady state has been reached, the response of the network is automatically extinguished by inhibitory signals from a steadiness-detecting cell. If the same stimulus is still presented after inhibition, a response for another pattern, formerly suppressed, will now appear, because the cells of the network have adaptation characteristics which makes the same response unlikely to recur. Since inhibition occurs repeatedly, the superposed input patterns are recalled one by one in turn.Keywords
This publication has 16 references indexed in Scilit:
- Storage of a temporal pattern sequence in a networkBiological Cybernetics, 1982
- Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in positionPattern Recognition, 1982
- Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in positionBiological Cybernetics, 1980
- Columnar cortico-cortical interconnections within the visual system of the squirrel and macaque monkeysBrain Research, 1979
- Behavioral Neurochemistry: Neuroregulators and Behavioral StatesScience, 1978
- Ferrier lecture - Functional architecture of macaque monkey visual cortexProceedings of the Royal Society of London. B. Biological Sciences, 1977
- Reciprocal point‐to‐point connections between parastriate and striate cortex in the squirrel monkey (Saimiri)Journal of Comparative Neurology, 1973
- A model of associative memory in the brainBiological Cybernetics, 1973
- The properties of the cerebello-pontine reverberating circuitBrain Research, 1972
- The possibilities of neural holographic processes within the brainBiological Cybernetics, 1970