Variational Bayesian surrogate modelling with application to robust design optimisation
Authors:
Preprint
Abstract
Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current computational models are usually high-dimensional and uncertain. We consider Bayesian inference for constructing statistical surrogates with input uncertainties and intrinsic dimensionality reduction. The surrogates are trained by fitting to data from prevalent deterministic computational models. The assumed prior probability density of the surrogate is a Gaussian process. We determine the respective posterior probability density and parameters of the posited statistical model using variational Bayes. The non-Gaussian posterior is approximated by a simpler trial density with free variational parameters and the discrepancy between them is measured using the Kullback-Leibler (KL) divergence. We employ the stochastic gradient method to compute the variational parameters and other statistical model parameters by minimising the KL divergence. We demonstrate the accuracy and versatility of the proposed reduced dimension variational Gaussian process (RDVGP) surrogate on illustrative and robust structural optimisation problems with cost functions depending on a weighted sum of the mean and standard deviation of model outputs.Keywords
All Related Versions
This publication has 46 references indexed in Scilit:
- Robust topology optimisation of lattice structures with spatially correlated uncertaintiesStructural and Multidisciplinary Optimization, 2024
- Multi‐fidelity data fusion through parameter space reduction with applications to automotive engineeringInternational Journal for Numerical Methods in Engineering, 2023
- State-of-the-Art and Comparative Review of Adaptive Sampling Methods for KrigingArchives of Computational Methods in Engineering, 2020
- Structural reliability analysis via dimension reduction, adaptive sampling, and Monte Carlo simulationStructural and Multidisciplinary Optimization, 2020
- Modeling and optimization with Gaussian processes in reduced eigenbasesStructural and Multidisciplinary Optimization, 2020
- Improving kriging surrogates of high-dimensional design models by Partial Least Squares dimension reductionStructural and Multidisciplinary Optimization, 2016
- Topology optimization of continuum structures under uncertainty – A Polynomial Chaos approachComputer Methods in Applied Mechanics and Engineering, 2012
- A comprehensive framework for verification, validation, and uncertainty quantification in scientific computingComputer Methods in Applied Mechanics and Engineering, 2011
- Computational methods in optimization considering uncertainties – An overviewComputer Methods in Applied Mechanics and Engineering, 2008
- Robust design of structures using optimization methodsComputer Methods in Applied Mechanics and Engineering, 2004