Distributed Tracking of Correlated Equilibria in Regime Switching Noncooperative Games
- 3 April 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 58 (10) , 2435-2450
Abstract
We consider a class of regime-switching noncooperative repeated games where agents exchange information over a graph. The parameters of the game (number of agents, payoffs, information exchange graph) evolve randomly over time according to a Markov chain. We present a regret-based stochastic approximation algorithm with constant step-size that prescribes how individual agents update their randomized strategies over time. We show that, if the Markov chain jump changes on the same timescale as the adaptation rate of the stochastic approximation algorithm and agents independently follow this algorithm, their collective behavior is agile in tracking the time-varying convex polytope of correlated equilibria. The analysis is carried out using weak convergence methods and Lyapunov stability of switched Markovian differential inclusions.Keywords
This publication has 20 references indexed in Scilit:
- Collaborative Sub-Channel Allocation in Cognitive LTE Femto-Cells: A Cooperative Game-Theoretic ApproachIEEE Transactions on Communications, 2012
- Decentralized dynamic spectrum access for cognitive radios: cooperative design of a non-cooperative gameIEEE Transactions on Communications, 2009
- On Stability of Randomly Switched Nonlinear SystemsIEEE Transactions on Automatic Control, 2007
- Stochastic Approximations and Differential Inclusions, Part II: ApplicationsMathematics of Operations Research, 2006
- Stability analysis of deterministic and stochastic switched systems via a comparison principle and multiple Lyapunov functionsSIAM Journal on Control and Optimization, 2006
- Adaptive HeuristicsEconometrica, 2005
- On the geometry of Nash equilibria and correlated equilibriaInternational Journal of Game Theory, 2004
- A General Class of Adaptive StrategiesJournal of Economic Theory, 2001
- Continuous-Time Markov Chains and Applications1998
- Correlated Equilibrium as an Expression of Bayesian RationalityEconometrica, 1987