xesn: Echo state networks powered by Xarray and Dask
Open Access
- 12 November 2024
- journal article
- Published by The Open Journal in Journal of Open Source Software
- Vol. 9 (103) , 7286
Abstract
Xesn is a Python package that allows scientists to easily design Echo State Networks (ESNs) for forecasting problems. ESNs are a Recurrent Neural Network architecture introduced by Jaeger (2001) that are part of a class of techniques termed Reservoir Computing. One defining characteristic of these techniques is that all internal weights are determined by a handful of global, scalar parameters, thereby avoiding problems during backpropagation and reducing training time significantly. Because this architecture is conceptually simple, many scientists implement ESNs from scratch, leading to questions about computational performance. Xesn offers a straightforward, standard implementation of ESNs that operates efficiently on CPU and GPU hardware. The package leverages optimization tools to automate the parameter selection process, so that scientists can reduce the time finding a good architecture and focus on using ESNs for their domain application. Importantly, the package flexibly handles forecasting tasks for out-of-core, multi-dimensional datasets, eliminating the need to write parallel programming code. Xesn was initially developed to handle the problem of forecasting weather dynamics, and so it integrates naturally with Python packages that have become familiar to weather and climate scientists such as Xarray (Hoyer & Hamman, 2017). However, the software is ultimately general enough to be utilized in other domains where ESNs have been useful, such as in signal processing (Jaeger & Haas, 2004).Keywords
This publication has 16 references indexed in Scilit:
- Temporal Subsampling Diminishes Small Spatial Scales in Recurrent Neural Network Emulators of Geophysical TurbulenceJournal of Advances in Modeling Earth Systems, 2023
- A Hybrid Atmospheric Model Incorporating Machine Learning Can Capture Dynamical Processes Not Captured by Its Physics‐Based ComponentGeophysical Research Letters, 2023
- A systematic exploration of reservoir computing for forecasting complex spatiotemporal dynamicsNeural Networks, 2022
- A Hybrid Approach to Atmospheric Modeling That Combines Machine Learning With a Physics‐Based Numerical ModelJournal of Advances in Modeling Earth Systems, 2022
- ReservoirPy: An Efficient and User-Friendly Library to Design Echo State Networks2020
- Array programming with NumPyNature, 2020
- A Machine Learning‐Based Global Atmospheric Forecast ModelGeophysical Research Letters, 2020
- Scalable gradient–enhanced artificial neural networks for airfoil shape design in the subsonic and transonic regimesStructural and Multidisciplinary Optimization, 2020
- SciPy 1.0: fundamental algorithms for scientific computing in PythonNature Methods, 2020
- Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing ApproachPhysical Review Letters, 2018