Interpretable Cognitive Ability Prediction: A Comprehensive Gated Graph Transformer Framework for Analyzing Functional Brain Networks
- 18 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 43 (4) , 1568-1578
Abstract
Graph convolutional deep learning has emerged as a promising method to explore the functional organization of the human brain in neuroscience research. This paper presents a novel framework that utilizes the gated graph transformer (GGT) model to predict individuals’ cognitive ability based on functional connectivity (FC) derived from fMRI. Our framework incorporates prior spatial knowledge and uses a random-walk diffusion strategy that captures the intricate structural and functional relationships between different brain regions. Specifically, our approach employs learnable structural and positional encodings (LSPE) in conjunction with a gating mechanism to efficiently disentangle the learning of positional encoding (PE) and graph embeddings. Additionally, we utilize the attention mechanism to derive multi-view node feature embeddings and dynamically distribute propagation weights between each node and its neighbors, which facilitates the identification of significant biomarkers from functional brain networks and thus enhances the interpretability of the findings. To evaluate our proposed model in cognitive ability prediction, we conduct experiments on two large-scale brain imaging datasets: the Philadelphia Neurodevelopmental Cohort (PNC) and the Human Connectome Project (HCP). The results show that our approach not only outperforms existing methods in prediction accuracy but also provides superior explainability, which can be used to identify important FCs underlying cognitive behaviors.Keywords
Funding Information
- NIH (R01 GM109068, R01 MH121101, R01 MH104680, R01 MH107354, P20 GM103472, P20 GM144641, R01 REB020407, R01 EB006841, 2U54MD007595)
- NSF (1539067)
- NSFC (62202442)
- Anhui Provincial Natural Science Foundation (2208085QF188)
This publication has 50 references indexed in Scilit:
- Signed graph representation learning for functional-to-structural brain network mappingMedical Image Analysis, 2022
- Modeling spatio-temporal patterns of holistic functional brain networks via multi-head guided attention graph neural networks (Multi-Head GAGNNs)Medical Image Analysis, 2022
- BrainGNN: Interpretable Brain Graph Neural Network for fMRI AnalysisMedical Image Analysis, 2021
- Functional network estimation using multigraph learning with application to brain maturation studyHuman Brain Mapping, 2021
- GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders2018
- Disease prediction using graph convolutional networks: Application to Autism Spectrum Disorder and Alzheimer’s diseaseMedical Image Analysis, 2018
- Working memory and fluid intelligence: Capacity, attention control, and secondary memory retrievalCognitive Psychology, 2014
- PERFORMANCE AND PASSING RATE DIFFERENCES OF AFRICAN AMERICAN AND WHITE PROSPECTIVE TEACHERS ON PRAXISTM EXAMINATIONS: A JOINT PROJECT OF THE NATIONAL EDUCATION ASSOCIATION (NEA) AND EDUCATIONAL TESTING SERVICE (ETS)ETS Research Report Series, 2011
- The Cerebellum and Cognition: Evidence from Functional Imaging StudiesThe Cerebellum, 2011
- The Raven's Progressive Matrices: Change and Stability over Culture and TimeCognitive Psychology, 2000