Online Optimization and Ambiguity-Based Learning of Distributionally Uncertain Dynamic Systems
- 2 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 69 (9) , 6153-6168
Abstract
This paper proposes a novel approach to construct data-driven online solutions to optimization problems (P) subject to a class of distributionally uncertain dynamical systems. The introduced framework allows for the simultaneous learning of distributional system uncertainty via a parameterized, control-dependent ambiguity set using a finite historical data set, and its use to make online decisions with probabilistic regret function bounds. Leveraging the merits of Machine Learning, the main technical approach relies on the theory of Distributional Robust Optimization (DRO), to hedge against uncertainty and provide less conservative results than standard Robust Optimization approaches. Starting from recent results that describe ambiguity sets via parameterized, and control-dependent empirical distributions as well as ambiguity radii, we first present a tractable reformulation of the corresponding optimization problem while maintaining the probabilistic guarantees. We then specialize these problems to the cases of 1) optimal one-stage control of distributionally uncertain nonlinear systems, and 2) resource allocation under distributional uncertainty. A novelty of this work is that it extends DRO to online optimization problems subject to a distributionally uncertain dynamical system constraint, handled via a control-dependent ambiguity set that leads to online-tractable optimization with probabilistic guarantees on regret bounds. Further, we introduce an online version of the Nesterov's accelerated-gradient algorithm, and analyze its performance to solve this class of problems via dissipativity theory.Keywords
Funding Information
- ONR (N00014-19-1-2471)
- Air Force Office of Scientific Research (FA9550-19-1-0235)
This publication has 36 references indexed in Scilit:
- Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulationsMathematical Programming, 2017
- Data-driven control: A behavioral approachSystems & Control Letters, 2017
- On the rate of convergence in Wasserstein distance of the empirical measureProbability Theory and Related Fields, 2014
- Convex Analysis and Monotone Operator Theory in Hilbert Spaces2011
- Planning Algorithms2006
- A note on persistency of excitationSystems & Control Letters, 2005
- Smooth minimization of non-smooth functionsMathematical Programming, 2004
- Introductory Lectures on Convex Optimization2004
- System Identification1999
- Variational Analysis1998