The Stabilisation of Equilibria in Evolutionary Game Dynamics through Mutation: Mutation Limits in Evolutionary Games
Authors:
- Johann BauerJBJohann Bauer
- Mark BroomMBMark Broom
- Eduardo AlonsoEAEduardo Alonso
Preprint
Abstract
The multi-population replicator dynamics (RD) can be considered a dynamic approach to the study of multi-player games, where it was shown to be related to Cross' learning, as well as of systems of coevolving populations. However, not all of its equilibria are Nash equilibria (NE) of the underlying game, and neither convergence to an NE nor convergence in general are guaranteed. Although interior equilibria are guaranteed to be NE, no interior equilibrium can be asymptotically stable in the multi-population RD, resulting, e.g., in cyclic orbits around a single interior NE. We introduce a new notion of equilibria of RD, called mutation limits, which is based on the inclusion of a naturally arising, simple form of mutation, but is invariant under the specific choice of mutation parameters. We prove the existence of such mutation limits for a large range of games, and consider a subclass of particular interest, that of attracting mutation limits. Attracting mutation limits are approximated by asymptotically stable equilibria of the (mutation-)perturbed RD, and hence, offer an approximate dynamic solution of the underlying game, especially if the original dynamic has no asymptotically stable equilibria. In this sense, mutation stabilises the system in certain cases and makes attracting mutation limits near-attainable. Furthermore, the relevance of attracting mutation limits as a game theoretic equilibrium concept is emphasised by a similarity of (mutation-)perturbed RD to the Q-learning algorithm in the context of multi-agent reinforcement learning. In contrast to the guaranteed existence of mutation limits, attracting mutation limits do not exist in all games, raising the question of their characterization.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- Advanced Fixed Point Theory for Economics2018
- Mutation Rate Evolution in Replicator DynamicsBulletin of Mathematical Biology, 2012
- Unifying Evolutionary DynamicsJournal of Theoretical Biology, 2002
- Mathematical properties of mutation-selection models1998
- Stability by Mutation in Evolutionary GamesGames and Economic Behavior, 1995
- The theory of normal form games from the differentiable viewpointInternational Journal of Game Theory, 1994
- Evolutionary Equilibria Resistant to MutationGames and Economic Behavior, 1994
- Rates of Transition and Transversion in Coding Sequences since the Human-Rodent DivergenceGenomics, 1994
- Mutation-Selection Models in Population Genetics and Evolutionary Game Theory1989
- Oddness of the number of equilibrium points: A new proofInternational Journal of Game Theory, 1973