Meta-Model Framework for Surrogate-Based Parameter Estimation in Dynamical Systems
Open Access
- 16 December 2019
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 181829-181841
Abstract
The central task in modeling complex dynamical systems is parameter estimation. This task is an optimization task that involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient predictive model that approximates the value of the objective function. The standard approach involves learning a surrogate from training examples that correspond to past evaluations of the objective function. Current surrogate-based optimization methods use static, predefined substitution strategies to decide when to use the surrogate and when the true objective. We introduce a meta-model framework where the substitution strategy is dynamically adapted to the solution space of the given optimization problem. The meta model encapsulates the objective function, the surrogate model and the model of the substitution strategy, as well as components for learning them. The framework can be seamlessly coupled with an arbitrary optimization algorithm without any modification: It replaces the objective function and autonomously decides how to evaluate a given candidate solution. We test the utility of the framework on three tasks of estimating parameters of real-world models of dynamical systems. The results show that the meta model significantly improves the efficiency of optimization, reducing the total number of evaluations of the objective function up to an average of 77%.Keywords
All Related Versions
Funding Information
- The Slovenian Research and Innovation Agency (N2-0128, P5-0093, P2-0103)
- Ministrstvo za visoko šolstvo, znanost in tehnologijo (C3330-17-5290121)
This publication has 25 references indexed in Scilit:
- Metalearning and Algorithm Selection: progress, state of the art and introduction to the 2018 Special IssueMachine Learning, 2017
- Efficient benchmarking of algorithm configurators via model-based surrogatesMachine Learning, 2017
- Scalable Gaussian process-based transfer surrogates for hyperparameter optimizationMachine Learning, 2017
- General Meta-Model Framework for Surrogate-Based Numerical OptimizationLecture Notes in Computer Science, 2017
- Reverse Engineering Under Uncertainty2015
- An evolving surrogate model-based differential evolution algorithmApplied Soft Computing, 2015
- Analyzing convergence performance of evolutionary algorithms: A statistical approachInformation Sciences, 2014
- Recent developments in parameter estimation and structure identification of biochemical and genomic systemsMathematical Biosciences, 2009
- Advances in Differential Evolution2008
- Mathematical Biology1993