Optimal Control and Filtering for Hierarchical Decision Problems With Constraint Based on Stackelberg Strategy
- 7 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 69 (9) , 6238-6245
Abstract
This paper considers the hierarchical decision problems with $H_{\infty }$ constraint, where the proposed feedback Stackelberg strategy incorporates a two-level control progress. The leader first announces his action at the beginning of the game and anticipates the follower's optimal response, the follower chooses a response to optimize his/her cost function with the information of the leader's action. The optimal action of the leader, coupled with the rational response of the follower, forms a Stackelberg equilibrium. Both the leader and the follower exchange their observations and historical control inputs. Under the assumption of linear feedback strategies, the problems are converted into unsolved feedback gain matrix. The introduced Pontryagin's maximum principle develops a solution based on the forward and backward stochastic difference equations (FBSDEs). The separation principle is proposed to deal with coupled state estimation gains and optimal controller gains. To this end, the necessary and sufficient solvability conditions for both finite horizon and infinite horizon case are derived.Keywords
Funding Information
- Science and Technology for Youth Innovation of Universities in Shandong Province (2021KJ086)
- National Natural Science Foundation of China (62003234, 61873179)
- Natural Science Foundation of Shandong Province (ZR2020QF048, ZR2018MF019)
This publication has 32 references indexed in Scilit:
- Control for networked control systems with remote and local controllers over unreliable communication channelAutomatica, 2018
- Infinite horizon linear-quadratic Stackelberg games for discrete-time stochastic systemsAutomatica, 2017
- Supply–demand balancing for power management in smart grid: A Stackelberg game approachApplied Energy, 2016
- Stochastic Stackelberg equilibria with applications to time-dependent newsvendor modelsJournal of Economic Dynamics and Control, 2013
- Stochastic control for discrete-time systems with state and disturbance dependent noiseAutomatica, 2007
- Optimal control of LTI systems over unreliable communication linksAutomatica, 2006
- H∞-type control for discrete-time stochastic systemsInternational Journal of Robust and Nonlinear Control, 1999
- Team-optimal closed-loop Stackelberg strategies in hierarchical control problemsAutomatica, 1980
- Additional aspects of the Stackelberg strategy in nonzero-sum gamesJournal of Optimization Theory and Applications, 1973
- On the Stackelberg strategy in nonzero-sum gamesJournal of Optimization Theory and Applications, 1973