On the Correlation between Reservoir Metrics and Performance for Time Series Classification under the Influence of Synaptic Plasticity
Authors:
Open Access
- 10 July 2014
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 9 (7) , e101792
Abstract
Reservoir computing provides a simpler paradigm of training recurrent networks by initialising and adapting the recurrent connections separately to a supervised linear readout. This creates a problem, though. As the recurrent weights and topology are now separated from adapting to the task, there is a burden on the reservoir designer to construct an effective network that happens to produce state vectors that can be mapped linearly into the desired outputs. Guidance in forming a reservoir can be through the use of some established metrics which link a number of theoretical properties of the reservoir computing paradigm to quantitative measures that can be used to evaluate the effectiveness of a given design. We provide a comprehensive empirical study of four metrics; class separation, kernel quality, Lyapunov's exponent and spectral radius. These metrics are each compared over a number of repeated runs, for different reservoir computing set-ups that include three types of network topology and three mechanisms of weight adaptation through synaptic plasticity. Each combination of these methods is tested on two time-series classification problems. We find that the two metrics that correlate most strongly with the classification performance are Lyapunov's exponent and kernel quality. It is also evident in the comparisons that these two metrics both measure a similar property of the reservoir dynamics. We also find that class separation and spectral radius are both less reliable and less effective in predicting performance.Keywords
This publication has 27 references indexed in Scilit:
- Improving liquid state machines through iterative refinement of the reservoirNeurocomputing, 2010
- Reservoir computing approaches to recurrent neural network trainingComputer Science Review, 2009
- Edge of chaos and prediction of computational performance for neural circuit modelsNeural Networks, 2007
- An experimental unification of reservoir computing methodsNeural Networks, 2007
- Malleability of Spike-Timing-Dependent Plasticity at the CA3-CA1 SynapseJournal of Neuroscience, 2006
- Real-Time Computation at the Edge of Chaos in Recurrent Neural NetworksNeural Computation, 2004
- Simple model of spiking neuronsIEEE Transactions on Neural Networks, 2003
- Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on PerturbationsNeural Computation, 2002
- Multidimensional curve classification using passing-through regionsPattern Recognition Letters, 1999
- Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPsScience, 1997