Bidirectional Mapping with Contrastive Learning on Multimodal Neuroimaging Data
- 1 October 2023
- book chapter
- Published by Springer Nature
- Vol. 14222, 138-148
Abstract
The modeling of the interaction between brain structure and function using deep learning techniques has yielded remarkable success in identifying potential biomarkers for different clinical phenotypes and brain diseases. However, most existing studies focus on one-way mapping, either projecting brain function to brain structure or inversely. This type of unidirectional mapping approach is limited by the fact that it treats the mapping as a one-way task and neglects the intrinsic unity between these two modalities. Moreover, when dealing with the same biological brain, mapping from structure to function and from function to structure yields dissimilar outcomes, highlighting the likelihood of bias in one-way mapping. To address this issue, we propose a novel bidirectional mapping model, named Bidirectional Mapping with Contrastive Learning (BMCL), to reduce the bias between these two unidirectional mappings via ROI-level contrastive learning. We evaluate our framework on clinical phenotype and neurodegenerative disease predictions using two publicly available datasets (HCP and OASIS). Our results demonstrate the superiority of BMCL compared to several state-of-the-art methods.Keywords
This publication has 27 references indexed in Scilit:
- Predicting Alzheimer’s disease progression using multi-modal deep learning approachScientific Reports, 2019
- The influence of construction methodology on structural brain network measures: A reviewJournal of Neuroscience Methods, 2015
- Functional brain network organisation of children between 2 and 5years derived from reconstructed activity of cortical sources of high-density EEG recordingsNeuroImage, 2013
- The WU-Minn Human Connectome Project: An overviewNeuroImage, 2013
- FSLNeuroImage, 2012
- FreeSurferNeuroImage, 2012
- Conn : A Functional Connectivity Toolbox for Correlated and Anticorrelated Brain NetworksBrain Connectivity, 2012
- Identification of Novel GDNF Isoforms and cis-Antisense GDNFOS Gene and Their Regulation in Human Middle Temporal Gyrus of Alzheimer DiseaseJournal of Biological Chemistry, 2011
- The rewarding effect of aggression is reduced by nucleus accumbens dopamine receptor antagonism in micePsychopharmacology, 2008
- The role of asymmetrical frontal cortical activity in aggressionPsychophysiology, 2007