Adjoint-aided inference of Gaussian process driven differential equations
Authors:
- Engineer BainomugishaEBEngineer Bainomugisha
Preprint
Abstract
Linear systems occur throughout engineering and the sciences, most notably as differential equations. In many cases the forcing function for the system is unknown, and interest lies in using noisy observations of the system to infer the forcing, as well as other unknown parameters. In differential equations, the forcing function is an unknown function of the independent variables (typically time and space), and can be modelled as a Gaussian process (GP). In this paper we show how the adjoint of a linear system can be used to efficiently infer forcing functions modelled as GPs, using a truncated basis expansion of the GP kernel. We show how exact conjugate Bayesian inference for the truncated GP can be achieved, in many cases with substantially lower computation than would be required using MCMC methods. We demonstrate the approach on systems of both ordinary and partial differential equations, and show that the basis expansion approach approximates well the true forcing with a modest number of basis vectors. Finally, we show how to infer point estimates for the non-linear model parameters, such as the kernel length-scales, using Bayesian optimisation.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Efficient reduced-rank methods for Gaussian processes with eigenfunction expansionsStatistics and Computing, 2022
- Uncertainty quantification and atmospheric source estimation with a discrepancy-based and a state-dependent adaptative MCMCEnvironmental Pollution, 2021
- Hilbert space methods for reduced-rank Gaussian process regressionStatistics and Computing, 2019
- Bayesian pollution source identification via an inverse physics modelComputational Statistics & Data Analysis, 2019
- A review of automatic differentiation and its efficient implementationWIREs Data Mining and Knowledge Discovery, 2019
- Statistics in Function Space2016
- Gradient-based MCMC samplers for dynamic causal modellingNeuroImage, 2016
- A least-squares inversion technique for identification of a point release: Application to Fusion Field Trials 2007Atmospheric Environment, 2014
- Inverse problems: A Bayesian perspectiveActa Numerica, 2010
- A Karhunen–Loeve decomposition of a Gaussian process generated by independent pairs of exponential random variablesJournal of Functional Analysis, 2008