Mengjun Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Mengjun Liu has a total of 34 co-authors. Here are the top co-authors by number of shared publications:
- Lichi Zhang
Shanghai Jiao Tong University
6 shared publications - Qian Wang
ShanghaiTech University
5 shared publications - Dongdong Chen
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
4 shared publications - Xiangyu Zhao
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
3 shared publications - Huifeng Zhang
Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
2 shared publications - Linlin Yao
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
2 shared publications
Latest Publications
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 37 (11) , 6329-6343
Enhancing Generative Models for Modality Imputation of 3-D MRIs via Consistency-Aware Refinement and Super-Resolution Guidance
Reconstructing missing modalities of magnetic resonance images (MRIs) is a significant challenge in the medical imaging field. Current generative approaches such as generative adversarial networks (GANs) and diffusion models (DFs) have shown promise in synthesizing high-fidelity 2-D slices. However, they fall short in producing high-quality 3-D results due to their inability to leverage the contextual information across adjacent slices, resulting in low-quality images with poor interplane consistency. This problem is exacerbated when trained on datasets obtained with 2-D scanning protocols, where different MRI modalities have varying resolution between slices, leading to blurry and low-resolution results. To overcome these issues, we propose a novel fine-tuning strategy that can enhance the 2-D multimodal synthesis models to improve both consistency and interplane resolution in 3-D images. We begin by developing a novel attention-based module that can effectively empower generative models to produce 3-D results with high consistency between adjacent slices. Furthermore, we incorporate self-supervised super-resolution (SR) to deal with the varying resolution problem and eventually improve the interplane resolution of generated images. Instead of directly applying SR models that may bring about potential artifacts, we design a novel uncertainty modulation strategy, which optimizes the utilization of super-resolved images for high-quality reconstruction. We extensively evaluate our method through supervised and unsupervised multimodal synthesis using different generative models, including GAN- and DM-based models, all of which demonstrate the superiority and flexibility of the proposed method.
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 37 (11) , 6329-6343
Enhancing Generative Models for Modality Imputation of 3-D MRIs via Consistency-Aware Refinement and Super-Resolution Guidance
Reconstructing missing modalities of magnetic resonance images (MRIs) is a significant challenge in the medical imaging field. Current generative approaches such as generative adversarial networks (GANs) and diffusion models (DFs) have shown promise in synthesizing high-fidelity 2-D slices. However, they fall short in producing high-quality 3-D results due to their inability to leverage the contextual information across adjacent slices, resulting in low-quality images with poor interplane consistency. This problem is exacerbated when trained on datasets obtained with 2-D scanning protocols, where different MRI modalities have varying resolution between slices, leading to blurry and low-resolution results. To overcome these issues, we propose a novel fine-tuning strategy that can enhance the 2-D multimodal synthesis models to improve both consistency and interplane resolution in 3-D images. We begin by developing a novel attention-based module that can effectively empower generative models to produce 3-D results with high consistency between adjacent slices. Furthermore, we incorporate self-supervised super-resolution (SR) to deal with the varying resolution problem and eventually improve the interplane resolution of generated images. Instead of directly applying SR models that may bring about potential artifacts, we design a novel uncertainty modulation strategy, which optimizes the utilization of super-resolved images for high-quality reconstruction. We extensively evaluate our method through supervised and unsupervised multimodal synthesis using different generative models, including GAN- and DM-based models, all of which demonstrate the superiority and flexibility of the proposed method.
- 7 August 2026
- Published by Elsevier in Medical Image Analysis
- Vol. 114
Topology-constrained graph transformer network for structural and functional brain organization
- 7 August 2026
- Published by Elsevier in Medical Image Analysis
- Vol. 114
Topology-constrained graph transformer network for structural and functional brain organization
- 17 December 2024
- Published by Elsevier in Knowledge-Based Systems
- Vol. 309
Guiding fusion of dynamic functional and effective connectivity in spatio-temporal graph neural network for brain disorder classification
- 17 December 2024
- Published by Elsevier in Knowledge-Based Systems
- Vol. 309
Guiding fusion of dynamic functional and effective connectivity in spatio-temporal graph neural network for brain disorder classification
- 25 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (7) , 12400-12414
Exploring Multiconnectivity and Subdivision Functions of Brain Network via Heterogeneous Graph Network for Cognitive Disorder Identification
Brain serves as a critical cornerstone of human intelligence, which involves a series of complex neuropsychological activities that lead to the coordination of various functions in the brain network. In recent years, brain network analysis methods based on graph neural networks (GNNs) have attracted increasing attention for the identification of brain disorders. However, these methods generally assume that the brain network is a homogeneous graph while ignoring its heterogeneity among human brain activities, which is reflected in both the complex connectivity of the brain network and distinctive brain functions. To overcome this problem, we propose a heterogeneous subdivision GNN (HSGNN), which captures the heterogeneous connections and functions of the brain network simultaneously. Specifically, we first employ two fundamental brain connectivity patterns to capture both statistical dependency and directional information flow among different brain regions and construct a heterogeneous brain connectivity network for each subject. Then, we develop a functional subdivision method that encodes brain networks into multiple latent feature subspaces corresponding to heterogeneous brain functions and extracts features of brain networks accordingly. Considering the intricate interactions of brain functions to facilitate cognitive activities within the brain network, we further employ the self-attention mechanism to obtain comprehensive representations of brain networks in a joint latent space. Finally, we propose a composite loss function to train the model for obtaining the heterogeneous brain network representation, which can be utilized for disease classification. The experimental results in the Alzheimer’s Disease Neuroimaging Initiative (ADNI) and Autism Brain Imaging Data Exchange (ABIDE) datasets demonstrate that our method outperforms several state-of-the-art (SOTA) methods to identify different types of brain cognitive-related disorders.
- 25 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (7) , 12400-12414
Exploring Multiconnectivity and Subdivision Functions of Brain Network via Heterogeneous Graph Network for Cognitive Disorder Identification
Brain serves as a critical cornerstone of human intelligence, which involves a series of complex neuropsychological activities that lead to the coordination of various functions in the brain network. In recent years, brain network analysis methods based on graph neural networks (GNNs) have attracted increasing attention for the identification of brain disorders. However, these methods generally assume that the brain network is a homogeneous graph while ignoring its heterogeneity among human brain activities, which is reflected in both the complex connectivity of the brain network and distinctive brain functions. To overcome this problem, we propose a heterogeneous subdivision GNN (HSGNN), which captures the heterogeneous connections and functions of the brain network simultaneously. Specifically, we first employ two fundamental brain connectivity patterns to capture both statistical dependency and directional information flow among different brain regions and construct a heterogeneous brain connectivity network for each subject. Then, we develop a functional subdivision method that encodes brain networks into multiple latent feature subspaces corresponding to heterogeneous brain functions and extracts features of brain networks accordingly. Considering the intricate interactions of brain functions to facilitate cognitive activities within the brain network, we further employ the self-attention mechanism to obtain comprehensive representations of brain networks in a joint latent space. Finally, we propose a composite loss function to train the model for obtaining the heterogeneous brain network representation, which can be utilized for disease classification. The experimental results in the Alzheimer’s Disease Neuroimaging Initiative (ADNI) and Autism Brain Imaging Data Exchange (ABIDE) datasets demonstrate that our method outperforms several state-of-the-art (SOTA) methods to identify different types of brain cognitive-related disorders.
- 15 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1826-1837
Hierarchical Encoding and Fusion of Brain Functions for Depression Subtype Classification
Depression is a serious mental disorder with complex etiology, exhibiting strong heterogeneity in clinical manifestations such as various subtypes. Research on depression subtypes may deepen the understanding of the disease, contributing to the diagnosis and prognosis. While brain functional network and graph neural networks (GNNs) provide such a means, the task is still challenged by limited feature encoding from the informative fMRI data, ineffective information fusion of brain functional network, and small size of the recruited subjects. Therefore, we propose a hierarchical encoding and fusion framework of brain functions. First, we pre-train a model to extract the features from individual brain regions, which signify nodes in the brain functional network. Then, distinct graphs are constructed to link the nodes within each subject, resulting in multi-view graphs of the brain functional network. We further develop a graph fusion strategy to integrate the multi-view information, by referring to the local encoding of the nodes and their interactions across multiple graph instances. Finally, we attain the classification of depression subtypes based on the fused graph representation. The experimental results demonstrate that our method can superiorly distinguish major depression subtypes and outperform the state-of-the-art methods.
- 15 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1826-1837
Hierarchical Encoding and Fusion of Brain Functions for Depression Subtype Classification
Depression is a serious mental disorder with complex etiology, exhibiting strong heterogeneity in clinical manifestations such as various subtypes. Research on depression subtypes may deepen the understanding of the disease, contributing to the diagnosis and prognosis. While brain functional network and graph neural networks (GNNs) provide such a means, the task is still challenged by limited feature encoding from the informative fMRI data, ineffective information fusion of brain functional network, and small size of the recruited subjects. Therefore, we propose a hierarchical encoding and fusion framework of brain functions. First, we pre-train a model to extract the features from individual brain regions, which signify nodes in the brain functional network. Then, distinct graphs are constructed to link the nodes within each subject, resulting in multi-view graphs of the brain functional network. We further develop a graph fusion strategy to integrate the multi-view information, by referring to the local encoding of the nodes and their interactions across multiple graph instances. Finally, we attain the classification of depression subtypes based on the fused graph representation. The experimental results demonstrate that our method can superiorly distinguish major depression subtypes and outperform the state-of-the-art methods.
- 30 March 2024
- Published by Elsevier in Medical Image Analysis
- Vol. 94, 103158
Spatial attention-based implicit neural representation for arbitrary reduction of MRI slice spacing
- 30 March 2024
- Published by Elsevier in Medical Image Analysis
- Vol. 94, 103158
Spatial attention-based implicit neural representation for arbitrary reduction of MRI slice spacing
- 20 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 43 (7) , 2537-2546
Randomizing Human Brain Function Representation for Brain Disease Diagnosis
Resting-state fMRI (rs-fMRI) is an effective tool for quantifying functional connectivity (FC), which plays a crucial role in exploring various brain diseases. Due to the high dimensionality of fMRI data, FC is typically computed based on the region of interest (ROI), whose parcellation relies on a pre-defined atlas. However, utilizing the brain atlas poses several challenges including (1) subjective selection bias in choosing from various brain atlases, (2) parcellation of each subject’s brain with the same atlas yet disregarding individual specificity; (3) lack of interaction between brain region parcellation and downstream ROI-based FC analysis. To address these limitations, we propose a novel randomizing strategy for generating brain function representation to facilitate neural disease diagnosis. Specifically, we randomly sample brain patches, thus avoiding ROI parcellations of the brain atlas. Then, we introduce a new brain function representation framework for the sampled patches. Each patch has its function description by referring to anchor patches, as well as the position description. Furthermore, we design an adaptive-selection-assisted Transformer network to optimize and integrate the function representations of all sampled patches within each brain for neural disease diagnosis. To validate our framework, we conduct extensive evaluations on three datasets, and the experimental results establish the effectiveness and generality of our proposed method, offering a promising avenue for advancing neural disease diagnosis beyond the confines of traditional atlas-based methods. Our code is available at https://github.com/mjliu2020/RandomFR.
- 20 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 43 (7) , 2537-2546
Randomizing Human Brain Function Representation for Brain Disease Diagnosis
Resting-state fMRI (rs-fMRI) is an effective tool for quantifying functional connectivity (FC), which plays a crucial role in exploring various brain diseases. Due to the high dimensionality of fMRI data, FC is typically computed based on the region of interest (ROI), whose parcellation relies on a pre-defined atlas. However, utilizing the brain atlas poses several challenges including (1) subjective selection bias in choosing from various brain atlases, (2) parcellation of each subject’s brain with the same atlas yet disregarding individual specificity; (3) lack of interaction between brain region parcellation and downstream ROI-based FC analysis. To address these limitations, we propose a novel randomizing strategy for generating brain function representation to facilitate neural disease diagnosis. Specifically, we randomly sample brain patches, thus avoiding ROI parcellations of the brain atlas. Then, we introduce a new brain function representation framework for the sampled patches. Each patch has its function description by referring to anchor patches, as well as the position description. Furthermore, we design an adaptive-selection-assisted Transformer network to optimize and integrate the function representations of all sampled patches within each brain for neural disease diagnosis. To validate our framework, we conduct extensive evaluations on three datasets, and the experimental results establish the effectiveness and generality of our proposed method, offering a promising avenue for advancing neural disease diagnosis beyond the confines of traditional atlas-based methods. Our code is available at https://github.com/mjliu2020/RandomFR.