Recurrent correlation associative memories
Authors:
- T.-D. ChiuehTCT.-D. Chiueh
- R.M. GoodmanRGR.M. Goodman
- 1 March 1991
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 2 (2) , 275-284
Abstract
A model for a class of high-capacity associative memories is presented. Since they are based on two-layer recurrent neural networks and their operations depend on the correlation measure, these associative memories are called recurrent correlation associative memories (RCAMs). The RCAMs are shown to be asymptotically stable in both synchronous and asynchronous (sequential) update modes as long as their weighting functions are continuous and monotone nondecreasing. In particular, a high-capacity RCAM named the exponential correlation associative memory (ECAM) is proposed. The asymptotic storage capacity of the ECAM scales exponentially with the length of memory patterns, and it meets the ultimate upper bound for the capacity of associative memories. The asymptotic storage capacity of the ECAM with limited dynamic range in its exponentiation nodes is found to be proportional to that dynamic range. Design and fabrication of a 3-mm CMOS ECAM chip is reported. The prototype chip can store 32 24-bit memory patterns, and its speed is higher than one associative recall operation every 3 mus. An application of the ECAM chip to vector quantization is also described.Keywords
This publication has 9 references indexed in Scilit:
- Analog VLSI Implementation of Neural Systems1989
- General potential surfaces and neural networksPhysical Review A, 1988
- High-capacity exponential associative memories1988
- The capacity of the Hopfield associative memoryIEEE Transactions on Information Theory, 1987
- Neurons with graded response have collective computational properties like those of two-state neurons.Proceedings of the National Academy of Sciences of the United States of America, 1984
- Vector quantizationIEEE ASSP Magazine, 1984
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- A simple neural network generating an interactive memoryMathematical Biosciences, 1972
- Correlation Matrix MemoriesIEEE Transactions on Computers, 1972