Goal-Oriented Optimal Design of Experiments for Large-Scale Bayesian Linear Inverse Problems
Preprint
Abstract
We develop a framework for goal-oriented optimal design of experiments (GOODE) for large-scale Bayesian linear inverse problems governed by PDEs. This framework differs from classical Bayesian optimal design of experiments (ODE) in the following sense: we seek experimental designs that minimize the posterior uncertainty in the experiment end-goal, e.g., a quantity of interest (QoI), rather than the estimated parameter itself. This is suitable for scenarios in which the solution of an inverse problem is an intermediate step and the estimated parameter is then used to compute a QoI. In such problems, a GOODE approach has two benefits: the designs can avoid wastage of experimental resources by a targeted collection of data, and the resulting design criteria are computationally easier to evaluate due to the often low-dimensionality of the QoIs. We present two modified design criteria, A-GOODE and D-GOODE, which are natural analogues of classical Bayesian A- and D-optimal criteria. We analyze the connections to other ODE criteria, and provide interpretations for the GOODE criteria by using tools from information theory. Then, we develop an efficient gradient-based optimization framework for solving the GOODE optimization problems. Additionally, we present comprehensive numerical experiments testing the various aspects of the presented approach. The driving application is the optimal placement of sensors to identify the source of contaminants in a diffusion and transport problem. We enforce sparsity of the sensor placements using an $\ell_1$-norm penalty approach, and propose a practical strategy for specifying the associated penalty parameter.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- Randomized matrix-free trace and log-determinant estimatorsNumerische Mathematik, 2017
- A Hybrid Monte‐Carlo sampling smoother for four‐dimensional data assimilationInternational Journal for Numerical Methods in Fluids, 2016
- The reduced‐order hybrid Monte Carlo sampling smootherInternational Journal for Numerical Methods in Fluids, 2016
- Optimal Bayesian Experimental Design for Priors of Compact Support with Application to Shock‐Tube Experiments for Combustion KineticsInternational Journal for Numerical Methods in Engineering, 2016
- Fast Bayesian optimal experimental design for seismic source inversionComputer Methods in Applied Mechanics and Engineering, 2015
- A Laplace method for under-determined Bayesian optimal experimental designsComputer Methods in Applied Mechanics and Engineering, 2015
- Fast estimation of expected information gains for Bayesian experimental designs based on Laplace approximationsComputer Methods in Applied Mechanics and Engineering, 2013
- Simulation-based optimal Bayesian experimental design for nonlinear systemsJournal of Computational Physics, 2013
- Numerical methods for A-optimal designs with a sparsity constraint for ill-posed inverse problemsComputational Optimization and Applications, 2011
- Optimal Experimental Design for the Large‐Scale Nonlinear Ill‐Posed Problem of Impedance Imaging2010