Adversarially robust Bayesian optimization for efficient auto‐tuning of generic control structures under uncertainty
- 10 January 2022
- journal article
- research article
- Published by Wiley in AIChE Journal
- Vol. 68 (6) , e17591
Abstract
The performance of optimization‐ and learning‐based controllers critically depends on the selection of several tuning parameters that can affect the closed‐loop control performance and constraint satisfaction in highly nonlinear and nonconvex ways. Due to the black‐box nature of the relationship between tuning parameters and general closed‐loop performance measures, there has been a significant interest in automatic calibration (i.e., auto‐tuning) of complex control structures using derivative‐free optimization methods, including Bayesian optimization (BO) that can handle expensive unknown cost functions. Nevertheless, an open challenge when applying BO to auto‐tuning is how to effectively deal with uncertainties in the closed‐loop system that cannot be attributed to a lumped, small‐scale noise term. This article addresses this challenge by developing an adversarially robust BO (ARBO) method that is particularly suited to auto‐tuning problems with significant time‐invariant uncertainties in an expensive system model used for closed‐loop simulations. ARBO relies on a Gaussian process model that jointly describes the effect of the tuning parameters and uncertainties on the closed‐loop performance. From this joint Gaussian process model, ARBO uses an alternating confidence‐bound procedure to simultaneously select the next candidate tuning and uncertainty realizations, implying only one expensive closed‐loop simulation is needed at each iteration. The advantages of ARBO are demonstrated on two case studies, including an illustrative problem and auto‐tuning of a nonlinear model predictive controller using a benchmark bioreactor problem.Keywords
All Related Versions
Funding Information
- National Aeronautics and Space Administration (NNX17AJ31G)
- National Science Foundation of Sri Lanka (2029282)
This publication has 32 references indexed in Scilit:
- A new expected-improvement algorithm for continuous minimax optimizationJournal of Global Optimization, 2015
- A model-free approach for auto-tuning of model predictive controlIFAC Proceedings Volumes, 2014
- Model Predictive Control Tuning Methods: A ReviewIndustrial & Engineering Chemistry Research, 2010
- Global sensitivity analysis using polynomial chaos expansionsReliability Engineering & System Safety, 2008
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- Multi-armed Bandit Algorithms and Empirical Evaluation2005
- Algorithm 778: L-BFGS-BACM Transactions on Mathematical Software, 1997
- On Latin hypercube samplingThe Annals of Statistics, 1996
- Nonlinear control strategies for continuous fermentersChemical Engineering Science, 1992
- An algorithm for operating a fed‐batch fermentor at optimum specific‐growth rateBiotechnology and Bioengineering, 1989