SGSR: Structure-Guided Multi-Contrast MRI Super-Resolution via Spatio-Frequency Co-Query Attention
Preprint
Abstract
Magnetic Resonance Imaging (MRI) is a leading diagnostic modality for a wide range of exams, where multiple contrast images are often acquired for characterizing different tissues. However, acquiring high-resolution MRI typically extends scan time, which can introduce motion artifacts. Super-resolution of MRI therefore emerges as a promising approach to mitigate these challenges. Earlier studies have investigated the use of multiple contrasts for MRI super-resolution (MCSR), whereas majority of them did not fully exploit the rich contrast-invariant structural information. To fully utilize such crucial prior knowledge of multi-contrast MRI, in this work, we propose a novel structure-guided MCSR (SGSR) framework based on a new spatio-frequency co-query attention (CQA) mechanism. Specifically, CQA performs attention on features of multiple contrasts with a shared structural query, which is particularly designed to extract, fuse, and refine the common structures from different contrasts. We further propose a novel frequency-domain CQA module in addition to the spatial domain, to enable more fine-grained structural refinement. Extensive experiments on fastMRI knee data and low-field brain MRI show that SGSR outperforms state-of-the-art MCSR methods with statistical significance.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling2023
- Accurate Multi-contrast MRI Super-Resolution via a Dual Cross-Attention Transformer Network2023
- M4Raw: A multi-contrast, multi-repetition, multi-channel MRI k-space dataset for low-field MRI researchScientific Data, 2023
- Efficient Long-Range Attention Network for Image Super-Resolution2022
- WavTrans: Synergizing Wavelet and Cross-Attention Transformer for Multi-contrast MRI Super-Resolution2022
- DuDoCAF: Dual-Domain Cross-Attention Fusion with Recurrent Transformer for Fast Multi-contrast MR Imaging2022
- Multi-contrast MRI Super-Resolution via a Multi-stage Integration Network2021
- Adaptive convolutional neural networks for accelerating magnetic resonance imaging via k-space data interpolationMedical Image Analysis, 2021
- DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction With Deep T1 Prior2020
- A Deep Information Sharing Network for Multi-Contrast Compressed Sensing MRI ReconstructionIEEE Transactions on Image Processing, 2019