Feedback and Open-Loop Nash Equilibria for LQ Infinite-Horizon Discrete-Time Dynamic Games
Preprint
Abstract
We consider dynamic games defined over an infinite horizon, characterized by linear, discrete-time dynamics and quadratic cost functionals. Considering such linear-quadratic (LQ) dynamic games, we focus on their solutions in terms Nash equilibrium strategies. Both Feedback (F-NE) and Open-Loop (OL-NE) Nash equilibrium solutions are considered. The contributions of the paper are threefold. First, our detailed study reveals some interesting structural insights in relation to F-NE solutions. Second, as a stepping stone towards our consideration of OL-NE strategies, we consider a specific infinite-horizon discrete-time (single-player) optimal control problem, wherein the dynamics are influenced by a known exogenous input and draw connections between its solution obtained via Dynamic Programming and Pontryagin's Minimum Principle. Finally, we exploit the latter result to provide a characterization of OL-NE strategies of the class of infinite-horizon dynamic games. The results and key observations made throughout the paper are illustrated via a numerical example.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- On the analysis of open-loop Nash equilibria admitting a feedback synthesis in nonlinear differential gamesAutomatica, 2022
- A note on topological aspects in dynamic games of resource extraction and economic growth theoryGames and Economic Behavior, 2022
- A multi-agent model to study epidemic spreading and vaccination strategies in an urban-like environmentApplied Network Science, 2020
- Stochastic Games with Unbounded Payoffs: Applications to Robust Control in EconomicsDynamic Games and Applications, 2011
- Dynamic Games in the Economics and Management of PollutionEnvironmental Modeling & Assessment, 2010
- Algorithms for computing Nash equilibria in deterministic LQ gamesComputational Management Science, 2006
- Discrete-Time Riccati Equations in Open-Loop Nash and Stackelberg GamesEuropean Journal of Control, 1999
- The solution of the infinite horizon tracking problem for discrete time systems possessing an exogenous componentJournal of Economic Dynamics and Control, 1990
- Further properties of nonzero-sum differential gamesJournal of Optimization Theory and Applications, 1969
- Nonzero-sum differential gamesJournal of Optimization Theory and Applications, 1969