Abstract
When the outcome of an action cannot be precisely known, it is difficult to select actions to get a desired result. This problem can be caused by uncertain parameters, such as not knowing how slippery a road is when driving in icy conditions. Adaptive control techniques can estimate uncertainties using past measurements, but the confidence in these estimates is not used to inform future control actions. Dual control, an improvement on adaptive control, can estimate the reductions in uncertainty that will result from control actions and probes the system to identify the uncertain parameters to a sufficient level to optimize the desired goal. However, existing dual control approaches have been computationally intractable for all but the simplest of control problems. Here we show that our novel and computationally efficient dual iterative linear quadratic Gaussian controller outcompetes an adaptive iterative linear quadratic Gaussian controller, using the control of COVID-19 as an example application. The dual controller performed 6.4% better than the adaptive controller in selecting policies to minimize the social and economic costs associated with both the policies and case counts using an established model of COVID-19 with sixteen uncertain parameters. Our results demonstrate that dual control is a powerful control tool that can handle complex, nonlinear, and stochastic systems in a robust and actively adaptive way while improving their performance.
Funding Information
  • Natural Sciences and Engineering Research Council of Canada
  • Natural Sciences and Engineering Research Council of Canada
  • New Brunswick Innovation Foundation

This publication has 15 references indexed in Scilit: