Abstract
This article introduces a class of model-free feedback methods for solving generic constrained optimization problems where the mathematical forms of the cost and constraint functions are not available. The proposed methods, termed projected zeroth-order (P-ZO) dynamics, incorporate projection maps into a class of continuous-time zeroth-order dynamics that use direct measurements of the cost function and periodic dithering for the purpose of gradient learning. In particular, the proposed P-ZO algorithms can be interpreted as new extremum-seeking algorithms that autonomously drive an unknown system toward a neighborhood of the set of solutions of an optimization problem using only output feedback, while simultaneously guaranteeing that the input trajectories remain in a feasible set for all times. In this way, the P-ZO algorithms can properly handle hard and asymptotic constraints in model-free optimization problems without using penalty terms or barrier functions. Moreover, the proposed dynamics have suitable robustness properties with respect to small bounded additive disturbances on the states and dynamics, a property that is fundamental for practical real-world implementations. Additional tracking results for time-varying and switching cost functions are also derived under stronger convexity and smoothness assumptions and using tools from hybrid dynamical systems. Numerical examples are presented throughout the article to illustrate the above-mentioned results.
Funding Information
  • NSF CAREER (ECCS 2305756)
  • NSF (CMII-2228791)
  • NSF AI Institute (2112085)
  • NSF ASCENT (2328241)
  • NSF CNS (2003111)
  • Air Force Office of Scientific Research (FA9550-22-1-0211)

This publication has 51 references indexed in Scilit: