Continuous-Time Zeroth-Order Dynamics With Projection Maps: Model-Free Feedback Optimization With Safety Guarantees
- 3 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 70 (8) , 5005-5020
Abstract
This article introduces a class of model-free feedback methods for solving generic constrained optimization problems where the mathematical forms of the cost and constraint functions are not available. The proposed methods, termed projected zeroth-order (P-ZO) dynamics, incorporate projection maps into a class of continuous-time zeroth-order dynamics that use direct measurements of the cost function and periodic dithering for the purpose of gradient learning. In particular, the proposed P-ZO algorithms can be interpreted as new extremum-seeking algorithms that autonomously drive an unknown system toward a neighborhood of the set of solutions of an optimization problem using only output feedback, while simultaneously guaranteeing that the input trajectories remain in a feasible set for all times. In this way, the P-ZO algorithms can properly handle hard and asymptotic constraints in model-free optimization problems without using penalty terms or barrier functions. Moreover, the proposed dynamics have suitable robustness properties with respect to small bounded additive disturbances on the states and dynamics, a property that is fundamental for practical real-world implementations. Additional tracking results for time-varying and switching cost functions are also derived under stronger convexity and smoothness assumptions and using tools from hybrid dynamical systems. Numerical examples are presented throughout the article to illustrate the above-mentioned results.Keywords
Funding Information
- NSF CAREER (ECCS 2305756)
- NSF (CMII-2228791)
- NSF AI Institute (2112085)
- NSF ASCENT (2328241)
- NSF CNS (2003111)
- Air Force Office of Scientific Research (FA9550-22-1-0211)
This publication has 51 references indexed in Scilit:
- Model-Free Stabilization by Extremum Seeking2017
- Random Gradient-Free Minimization of Convex FunctionsFoundations of Computational Mathematics, 2015
- A constrained extremum‐seeking control approachInternational Journal of Robust and Nonlinear Control, 2014
- Stochastic Averaging and Stochastic Extremum Seeking2012
- Input-to-state stability for a class of hybrid dynamical systems via averagingMathematics of Control, Signals, and Systems, 2011
- Viability Theory2011
- On non-local stability properties of extremum seeking controlAutomatica, 2006
- Extremum-seeking control of state-constrained nonlinear systemsAutomatica, 2005
- Projected Dynamical Systems and Variational Inequalities with Applications1996
- Differential Equations with Discontinuous Righthand Sides1988