DeepVolume: Brain Structure and Spatial Connection-Aware Network for Brain MRI Super-Resolution
- 30 August 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 51 (7) , 3441-3454
Abstract
Thin-section magnetic resonance imaging (MRI) can provide higher resolution anatomical structures and more precise clinical information than thick-section images. However, thin-section MRI is not always available due to the imaging cost issue. In multicenter retrospective studies, a large number of data are often in thick-section manner with different section thickness. The lack of thin-section data and the difference in section thickness bring considerable difficulties in the study based on the image big data. In this article, we introduce DeepVolume, a two-step deep learning architecture to address the challenge of accurate thin-section MR image reconstruction. The first stage is the brain structure-aware network, in which the thick-section MR images in axial and sagittal planes are fused by a multitask 3-D U-net with prior knowledge of brain volume segmentation, which encourages the reconstruction result to have correct brain structure. The second stage is the spatial connection-aware network, in which the preliminary reconstruction results are adjusted slice-by-slice by a recurrent convolutional network embedding convolutional long short-term memory (LSTM) block, which enhances the precision of the reconstruction by utilizing the previously unassessed sagittal information. We used 305 paired brain MRI samples with thickness of 1.0 mm and 6.5 mm in this article. Extensive experiments illustrate that DeepVolume can produce the state-of-the-art reconstruction results by embedding more anatomical knowledge. Furthermore, considering DeepVolume as an intermediate step, the practical and clinical value of our method is validated by applying the brain volume estimation and voxel-based morphometry. The results show that DeepVolume can provide much more reliable brain volume estimation in the normalized space based on the thick-section MR images compared with the traditional solutions.Keywords
Funding Information
- National Natural Science Foundation of China (61771143)
- National Key Research and Development Program of China (2015CB755500)
- Shanghai Shenkang Hospital Development Center Clinical Auxiliary Capacity (Imaging Medicine) Construction (SHDC22015031)
- Shanghai Science and Technology Committee (17DZ1930503)
- Shanghai Municipal Health Commission (2019SY038)
This publication has 61 references indexed in Scilit:
- Tracking the Roots of Reading Ability: White Matter Volume and Integrity Correlate with Phonological Awareness in Prereading and Early-Reading Kindergarten ChildrenThe Journal of Neuroscience, 2013
- Combining functional and anatomical connectivity reveals brain networks for auditory language comprehensionNeuroImage, 2010
- MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: Reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengthsNeuroImage, 2009
- Regional white matter volume differences in nondemented aging and Alzheimer's diseaseNeuroImage, 2009
- Brain morphometry with multiecho MPRAGENeuroImage, 2008
- The use of super‐resolution techniques to reduce slice thickness in functional MRIInternational Journal of Imaging Systems and Technology, 2004
- Voxel-Based Morphometry—The MethodsNeuroImage, 2000
- Fast, robust total variation-based reconstruction of noisy, blurred imagesIEEE Transactions on Image Processing, 1998
- Brain development, gender and IQ in childrenBrain, 1996
- B-spline signal processing. I. TheoryIEEE Transactions on Signal Processing, 1993