Good and bad predictions: Assessing and improving the replication of chaotic attractors by means of reservoir computing
Top Cited Papers
Open Access
- 1 October 2019
- journal article
- conference paper
- Published by AIP Publishing in Chaos: An Interdisciplinary Journal of Nonlinear Science
- Vol. 29 (10) , 103143
Abstract
The prediction of complex nonlinear dynamical systems with the help of machine learning techniques has become increasingly popular. In particular, reservoir computing turned out to be a very promising approach especially for the reproduction of the long-term properties of a nonlinear system. Yet, a thorough statistical analysis of the forecast results is missing. Using the Lorenz and Rössler system, we statistically analyze the quality of prediction for different parametrizations—both the exact short-term prediction as well as the reproduction of the long-term properties (the “climate”) of the system as estimated by the correlation dimension and largest Lyapunov exponent. We find that both short- and long-term predictions vary significantly among the realizations. Thus, special care must be taken in selecting the good predictions as realizations, which deliver better short-term prediction also tend to better resemble the long-term climate of the system. Instead of only using purely random Erdös-Renyi networks, we also investigate the benefit of alternative network topologies such as small world or scale-free networks and show which effect they have on the prediction quality. Our results suggest that the overall performance with respect to the reproduction of the climate of both the Lorenz and Rössler system is worst for scale-free networks. For the Lorenz system, there seems to be a slight benefit of using small world networks, while for the Rössler system, small world and Erdös-Renyi networks performed equivalently well. In general, the observation is that reservoir computing works for all network topologies investigated here.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Reservoir computing approaches to recurrent neural network trainingComputer Science Review, 2009
- Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless CommunicationScience, 2004
- Scale-Free NetworksScientific American, 2003
- Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on PerturbationsNeural Computation, 2002
- Statistical mechanics of complex networksReviews of Modern Physics, 2002
- Testing for nonlinearity in time series: the method of surrogate dataPhysica D: Nonlinear Phenomena, 1992
- Determining Lyapunov exponents from a time seriesPhysica D: Nonlinear Phenomena, 1985
- Generalized dimensions of strange attractorsPhysics Letters A, 1983
- An equation for continuous chaosPhysics Letters A, 1976
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970