Noise resistance of next-generation reservoir computing: a comparative study with high-order correlation computation
Open Access
- 2 June 2023
- journal article
- research article
- Published by Springer Nature in Nonlinear Dynamics
- Vol. 111 (15) , 14295-14308
Abstract
Reservoir computing (RC) methods have received more and more attention and applications in chaotic time series prediction with their simple structure and training method. Recently, the next-generation reservoir computing (NG-RC) method has been proposed by Gauthier et al. (Nat Commun 12:5564, 2021) with less training cost and better time series predictions. Nevertheless, in practice, available data on dynamic systems are contaminated with noise. Though NG-RC is shown highly efficient in learning and predicting, its noise resistance captivity is not clear yet, limiting its use in practical problems. In this paper, we study the noise resistance of the NG-RC method, taking the well-known denoising method, the high-order correlation computation (HOCC) method, as a reference. Both methods have similar procedures in respect of function bases and regression processes. With the simple ridge regression method, the NG-RC method has a strong noise resistance for white noise, even better than the HOCC method. Besides, the NG-RC method also shows a good prediction ability for small colored noise, while it does not provide correct reconstruct dynamics. In this paper, other than reconstruction parameters, four numerical indicators are used to check the noise resistance comprehensively, such as the training error, prediction error, prediction time, and auto-correlation prediction error, for both the short-time series and long climate predictions. Our results provide a systematic estimation of NG-RC’s noise resistance capacity, which is helpful for its applications in practical problems.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (11775034)
- Fundamental Research Funds for the Central Universities (Contract No. 2019XD-A10 and 2022RC26)
This publication has 31 references indexed in Scilit:
- Echo State Property Linked to an Input: Exploring a Fundamental Characteristic of Recurrent Neural NetworksNeural Computation, 2013
- Reconstructing a credit networkNature Physics, 2013
- Predicting Catastrophes in Nonlinear Dynamical Systems by Compressive SensingPhysical Review Letters, 2011
- An experimental unification of reservoir computing methodsNeural Networks, 2007
- Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless CommunicationScience, 2004
- Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on PerturbationsNeural Computation, 2002
- Time series analysis of air pollution and mortality: effects by cause, age and socioeconomic statusJournal of Epidemiology and Community Health, 2000
- Genome Sequence of the Nematode C. elegans : A Platform for Investigating BiologyScience, 1998
- Application of time series analysis in the clinical settingScandinavian Journal of Clinical and Laboratory Investigation, 1995
- Reconstruction of atmospheric pollutant concentrations from remote sensing data--An application of distributed parameter observer theoryIEEE Transactions on Automatic Control, 1982