MCAN: Multimodal Causal Adversarial Networks for Dynamic Effective Connectivity Learning From fMRI and EEG Data
- 25 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 43 (8) , 2913-2923
Abstract
Dynamic effective connectivity (DEC) is the accumulation of effective connectivity in the time dimension, which can describe the continuous neural activities in the brain. Recently, learning DEC from functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) data has attracted the attention of neuroinformatics researchers. However, the current methods fail to consider the gap between the fMRI and EEG modality, which can not precisely learn the DEC network from multimodal data. In this paper, we propose a multimodal causal adversarial network for DEC learning, named MCAN. The MCAN contains two modules: multimodal causal generator and multimodal causal discriminator. First, MCAN employs a multimodal causal generator with an attention-guided layer to produce a posterior signal and output a set of DEC networks. Then, the proposed method uses a multimodal causal discriminator to unsupervised calculate the joint gradient, which directs the update of the whole network. The experimental results on simulated data sets show that MCAN is superior to other state-of-the-art methods in learning the network structure of DEC and can effectively estimate the brain states. The experimental results on real data sets show that MCAN can better reveal abnormal patterns of brain activity and has good application potential in brain network analysis.Keywords
Funding Information
- National Natural Science Foundation of China Research Program (62106009, 62276010)
- Research and Development Program of Beijing Municipal Education Commission (KM202210005030, KZ202210005009)
This publication has 34 references indexed in Scilit:
- Intrinsic, dynamic and effective connectivity among large-scale brain networks modulated by oxytocinNeuroImage, 2021
- Dynamic effective connectivityNeuroImage, 2020
- A multimodal encoding model applied to imaging decision-related neural cascades in the human brainNeuroImage, 2018
- Multi-modal EEG and fMRI Source Estimation Using Sparse Constraints2017
- Exploring connectivity with large-scale Granger causality on resting-state functional MRIJournal of Neuroscience Methods, 2017
- Effective Connectivity of Cortical Sensorimotor Networks During Finger Movement Tasks: A Simultaneous fNIRS, fMRI, EEG StudyBrain Topography, 2016
- Can sliding-window correlations reveal dynamic functional connectivity in resting-state fMRI?NeuroImage, 2016
- Fusing concurrent EEG–fMRI with dynamic causal modeling: Application to effective connectivity during face perceptionNeuroImage, 2014
- Network modelling methods for FMRINeuroImage, 2011
- A Bayesian approach to determining connectivity of the human brainHuman Brain Mapping, 2005