A Variational Mean-Field Control Framework for Graph Representation Learning
- 22 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1-12
Abstract
Feature representation learning in graph neural networks (GNNs) is a dynamic process driven by progressive information exchange throughout the graph. Current GNNs typically apply pre-defined message-passing heuristics uniformly across all graph data, even when the assumed relational inductive bias conflicts with the intrinsic graph properties (e.g., heterophily). This limitation hinders a principled understanding of graph learning and motivates a shift from application-specific architectures toward a generalizable paradigm. In this work, we conceptualize GNN learning through the lens of mean-field control, where the desired learning outcome corresponds to a variational critical point, each node reaches a representation that is adaptively calibrated to both itself and the entire graph. Building on this formulation, we propose a mathematical framework based on mean-field control (MFC) to adaptively design GNNs for unseen graph data. Specifically, we jointly optimize two control patterns: diffusive mobility, governing information propagation across the graph, and reactive mobility, regulating feature transformation at individual nodes. Both controls are learned from each input instance by solving an MFC variational problem through Hamiltonian flows characterized by partial differential equations (PDE). Our variational framework unifies existing PDE-based GNNs as special mean-field games with fixed control patterns, and yields an end-to-end deep model, termed Nash-GNN. Extensive experiments show that Nash-GNN achieves state-of-the-art performance across diverse benchmarks, including heterophilic graphs and human connectomes. Beyond empirical gains, the MFC framework offers a principled lens to examine the mechanisms of graph representation learning through collective dynamics, opening promising directions for next-generation GNN design.Keywords
Funding Information
- National Institutes of Health (AG091653)
- Foundation of Hope for Research and Treatment of Mental Illness
This publication has 31 references indexed in Scilit:
- TauFlowNet: Revealing latent propagation mechanism of tau aggregates using deep neural transport equationsMedical Image Analysis, 2024
- The Parkinson's progression markers initiative (PPMI) – establishing a PD biomarker cohortAnnals of Clinical and Translational Neurology, 2018
- Autism spectrum disorderThe Lancet, 2018
- Information Geometry and Its Applications2016
- Neurodegeneration: The Molecular Pathology of Dementia and Movement Disorders2011
- Wavelets on graphs via spectral graph theoryApplied and Computational Harmonic Analysis, 2011
- Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclatureNeuroImage, 2010
- The Alzheimer's Disease Neuroimaging Initiative: Progress report and future plansAlzheimer's & Dementia, 2010
- Mean field gamesJapanese Journal of Mathematics, 2007
- Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject BrainNeuroImage, 2002