Efficient Time-Stepping for Numerical Integration Using Reinforcement Learning
- 26 April 2023
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Scientific Computing
- Vol. 45 (2) , A579-A595
Abstract
Many problems in science and engineering require an efficient numerical approximation of integrals or solutions to differential equations. For systems with rapidly changing dynamics, an equidistant discretization is often inadvisable as it results in prohibitively large errors or computational effort. To this end, adaptive schemes, such as solvers based on Runge–Kutta pairs, have been developed which adapt the step size based on local error estimations at each step. While the classical schemes apply very generally and are highly efficient on regular systems, they can behave suboptimally when an inefficient step rejection mechanism is triggered by structurally complex systems such as chaotic systems. To overcome these issues, we propose a method to tailor numerical schemes to the problem class at hand. This is achieved by combining simple, classical quadrature rules or ODE solvers with data-driven time-stepping controllers. Compared with learning solution operators to ODEs directly, it generalizes better to unseen initial data as our approach employs classical numerical schemes as base methods. At the same time it can make use of identified structures of a problem class and, therefore, outperforms state-of-the-art adaptive schemes. Several examples demonstrate superior efficiency. Source code is available at https://github.com/lueckem/quadrature-ML .Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- DGM: A deep learning algorithm for solving partial differential equationsJournal of Computational Physics, 2018
- Human-level control through deep reinforcement learningNature, 2015
- Vectorized adaptive quadrature in MATLABJournal of Computational and Applied Mathematics, 2008
- Numerical Analysis in Modern Scientific Computing2003
- The MATLAB ODE SuiteSIAM Journal on Scientific Computing, 1997
- Solving Ordinary Differential Equations II1996
- Chaos in a double pendulumAmerican Journal of Physics, 1992
- Q-learningMachine Learning, 1992
- Quadpack1983
- A family of embedded Runge-Kutta formulaeJournal of Computational and Applied Mathematics, 1980