Optimizing memory in reservoir computers
Author:
- 1 February 2022
- journal article
- conference paper
- Published by AIP Publishing in Chaos: An Interdisciplinary Journal of Nonlinear Science
- Vol. 32 (2) , 023123
Abstract
A reservoir computer is a way of using a high dimensional dynamical system for computation. One way to construct a reservoir computer is by connecting a set of nonlinear nodes into a network. Because the network creates feedback between nodes, the reservoir computer has memory. If the reservoir computer is to respond to an input signal in a consistent way (a necessary condition for computation), the memory must be fading; that is, the influence of the initial conditions fades over time. How long this memory lasts is important for determining how well the reservoir computer can solve a particular problem. In this paper, I describe ways to vary the length of the fading memory in reservoir computers. Tuning the memory can be important to achieve optimal results in some problems; too much or too little memory degrades the accuracy of the computation.Keywords
Funding Information
- U.S. Naval Research Laboratory
This publication has 33 references indexed in Scilit:
- Information Processing Capacity of Dynamical SystemsScientific Reports, 2012
- Information processing using a single dynamical node as complex systemNature Communications, 2011
- An experimental unification of reservoir computing methodsNeural Networks, 2007
- Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless CommunicationScience, 2004
- Statistical mechanics of complex networksReviews of Modern Physics, 2002
- New results on recurrent network training: unifying the algorithms and accelerating convergenceIEEE Transactions on Neural Networks, 2000
- Generalized synchronization of chaos: The auxiliary system approachPhysical Review E, 1996
- Fading memory and the problem of approximating nonlinear operators with Volterra seriesIEEE Transactions on Circuits and Systems, 1985
- Ergodic theory of chaos and strange attractorsReviews of Modern Physics, 1985
- An equation for continuous chaosPhysics Letters A, 1976