Physics-Informed Graph Neural Operator for Mean Field Games on Graph: A Scalable Learning Approach
Open Access
Abstract
Mean-field games (MFGs) are developed to model the decision-making processes of a large number of interacting agents in multi-agent systems. This paper studies mean-field games on graphs (-MFGs). The equilibria of -MFGs, namely, mean-field equilibria (MFE), are challenging to solve for their high-dimensional action space because each agent has to make decisions when they are at junction nodes or on edges. Furthermore, when the initial population state varies on graphs, we have to recompute MFE, which could be computationally challenging and memory-demanding. To improve the scalability and avoid repeatedly solving -MFGs every time their initial state changes, this paper proposes physics-informed graph neural operators (PIGNO). The PIGNO utilizes a graph neural operator to generate population dynamics, given initial population distributions. To better train the neural operator, it leverages physics knowledge to propagate population state transitions on graphs. A learning algorithm is developed, and its performance is evaluated on autonomous driving games on road networks. Our results demonstrate that the PIGNO is scalable and generalizable when tested under unseen initial conditions.
Keywords
Funding Information
- National Science Foundation Career (CMMI-1943998)
This publication has 9 references indexed in Scilit:
- Generalization in Mean Field Games by Learning Master PoliciesProceedings of the AAAI Conference on Artificial Intelligence, 2022
- Numerical Resolution of McKean-Vlasov FBSDEs Using Neural NetworksMethodology and Computing in Applied Probability, 2022
- Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games I: The Ergodic CaseSIAM Journal on Numerical Analysis, 2021
- A machine learning framework for solving high-dimensional mean field game and mean field control problemsProceedings of the National Academy of Sciences, 2020
- Mean-field models in swarm robotics: a surveyBioinspiration & Biomimetics, 2019
- Markov decision process routing games2017
- Existence and Uniqueness Result for Mean Field Games with Congestion Effect on GraphsApplied Mathematics & Optimization, 2014
- Mean field gamesJapanese Journal of Mathematics, 2007
- Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principleCommunications in Information and Systems, 2006