Cross-Modality Reference and Feature Mutual-Projection for 3D Brain MRI Image Super-Resolution
- 3 June 2024
- journal article
- research article
- Published by Springer Nature in Journal of Imaging Informatics in Medicine
- Vol. 37 (6) , 2838-2851
Abstract
High-resolution (HR) magnetic resonance imaging (MRI) can reveal rich anatomical structures for clinical diagnoses. However, due to hardware and signal-to-noise ratio limitations, MRI images are often collected with low resolution (LR) which is not conducive to diagnosing and analyzing clinical diseases. Recently, deep learning super-resolution (SR) methods have demonstrated great potential in enhancing the resolution of MRI images; however, most of them did not take the cross-modality and internal priors of MR seriously, which hinders the SR performance. In this paper, we propose a cross-modality reference and feature mutual-projection (CRFM) method to enhance the spatial resolution of brain MRI images. Specifically, we feed the gradients of HR MRI images from referenced imaging modality into the SR network to transform true clear textures to LR feature maps. Meanwhile, we design a plug-in feature mutual-projection (FMP) method to capture the cross-scale dependency and cross-modality similarity details of MRI images. Finally, we fuse all feature maps with parallel attentions to produce and refine the HR features adaptively. Extensive experiments on MRI images in the image domain and k-space show that our CRFM method outperforms existing state-of-the-art MRI SR methods.Keywords
Funding Information
- Natural Science Foundation of Chongqing Municipality (Grant cstc2021jcyi-bshX0168)
- National Natural Science Foundation of China (61962031)
- National Natural Science Foundation of China (62263015)
- Key projects of science and technology plan of Yunnan Provincial Department of Science and Technology (Grant 202201AS070029)
- Yunnan Province Education Department Scientific Research Fund Project (Grant 2023J0146)
This publication has 50 references indexed in Scilit:
- 3D dense convolutional neural network for fast and accurate single MR image super-resolutionComputerized Medical Imaging and Graphics, 2021
- FA-GAN: Fused attentive generative adversarial networks for MRI image super-resolutionComputerized Medical Imaging and Graphics, 2021
- A dual-task dual-domain model for blind MRI reconstructionComputerized Medical Imaging and Graphics, 2021
- Channel Splitting Network for Single MR Image Super-ResolutionIEEE Transactions on Image Processing, 2019
- Multiscale brain MRI super-resolution using deep 3D convolutional networksComputerized Medical Imaging and Graphics, 2019
- MR Image Super-Resolution via Wide Residual Networks With Fixed Skip ConnectionIEEE Journal of Biomedical and Health Informatics, 2018
- A New Sparse Representation Framework for Reconstruction of an Isotropic High Spatial Resolution MR Volume From Orthogonal Anisotropic Resolution ScansIEEE Transactions on Medical Imaging, 2017
- Reconstruction of High-Resolution Tongue Volumes From MRIIEEE Transactions on Biomedical Engineering, 2012
- Multi-parametric neuroimaging reproducibility: A 3-T resource studyNeuroImage, 2011
- Non-local MRI upsamplingMedical Image Analysis, 2010