Self-supervised pre-training based hybrid network for deep gray matter nuclei segmentation
Authors:
- Yang DengYDYang Deng
- Jiaxiu XiJXJiaxiu Xi
- Zhong ChenZCZhong Chen
- Lijun BaoLBLijun Bao
Open Access
- 1 February 2026
- journal article
- Published by KEAI Publishing in Magnetic Resonance Letters
- Vol. 6 (1)
Abstract
The accurate segmentation of deep gray matter nuclei is critical for neuropathological research, disease diagnosis and treatment. Existing methods employ the supervised learning training approach, which requires large labeled datasets. It is challenging and time-consuming to obtain such datasets for medical image analysis. In addition, these methods based on convolutional neural networks (CNNs) only achieve suboptimal performance due to the locality of convolutional operations. Vision Transformers (ViTs) efficiently model long-range dependencies and thus have the potentiality to outperform these methods in segmentation tasks. To address these issues, we propose a novel hybrid network based on self-supervised pre-training for deep gray matter nuclei segmentation. Specifically, we present a CNN-Transformer hybrid network (CTNet), whose encoder consists of 3D CNN and ViT to learn local spatial-detailed features and global semantic information. A self-supervised learning (SSL) approach that integrates rotation prediction and masked feature reconstruction is proposed to pre-train the CTNet, enabling the model to learn valuable visual representations from unlabeled data. We evaluate the effectiveness of our method on 3T and 7T human brain MRI datasets. The results demonstrate that our CTNet achieves better performance than other comparison models and our pre-training strategy outperforms other advanced self-supervised methods. When the training set has only one sample, our pre-trained CTNet enhances segmentation performance, showing an 8.4% improvement in Dice similarity coefficient (DSC) compared to the randomly initialized CTNet.Keywords
Funding Information
- National Natural Science Foundation of China (62071405)
- National Natural Science Foundation of China (12175189)
This publication has 27 references indexed in Scilit:
- The encoding method of position embeddings in vision transformerJournal of Visual Communication and Image Representation, 2022
- Jointly estimating bias field and reconstructing uniform MRI image by deep learningJournal of Magnetic Resonance, 2022
- Brain gray matter nuclei segmentation on quantitative susceptibility mapping using dual-branch convolutional neural networkArtificial Intelligence in Medicine, 2022
- Diffusion-regularized susceptibility tensor imaging (DRSTI) of tissue microstructures in the human brainMedical Image Analysis, 2020
- Progressive brain changes in Parkinson’s disease: A meta-analysis of structural magnetic resonance imaging studiesBrain Research, 2020
- Undersampled MR image reconstruction using an enhanced recursive residual networkJournal of Magnetic Resonance, 2019
- Differentiating Parkinson's disease motor subtypes using automated volume‐based morphometry incorporating white matter and deep gray nuclear lesion loadJournal of Magnetic Resonance Imaging, 2019
- Self-supervised learning for medical image analysis using image context restorationMedical Image Analysis, 2019
- Susceptibility‐weighted imaging: current status and future directionsNMR in Biomedicine, 2016
- Susceptibility-weighted imaging and quantitative susceptibility mapping in the brainJournal of Magnetic Resonance Imaging, 2014