Slice2Mesh: 3D Surface Reconstruction From Sparse Slices of Images for the Left Ventricle
- 12 December 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 44 (3) , 1541-1555
Abstract
Cine MRI is a widely used technique to evaluate left ventricular function and motion, as it captures temporal information. However, due to the limited spatial resolution, cine MRI only provides a few sparse scans at regular positions and orientations, which poses challenges for reconstructing dense 3D cardiac structures, which is essential for better understanding the cardiac structure and motion in a dynamic 3D manner. In this study, we propose a novel learning-based 3D cardiac surface reconstruction method, Slice2Mesh, which directly predicts accurate and high-fidelity 3D meshes from sparse slices of cine MRI images under partial supervision of sparse contour points. Slice2Mesh leverages a 2D UNet to extract image features and a graph convolutional network to predict deformations from an initial template to various 3D surfaces, which enables it to produce topology-consistent meshes that can better characterize and analyze cardiac movement. We also introduce As Rigid As Possible energy in the deformation loss to preserve the intrinsic structure of the predefined template and produce realistic left ventricular shapes. We evaluated our method on 150 clinical test samples and achieved an average chamfer distance of 3.621 mm, outperforming traditional methods by approximately 2.5 mm. We also applied our method to produce 4D surface meshes from cine MRI sequences and utilized a simple SVM model on these 4D heart meshes to identify subjects with myocardial infarction, and achieved a classification sensitivity of 91.8% on 99 test subjects, including 49 abnormal patients, which implies great potential of our method for clinical use.Keywords
Funding Information
- Beijing Nova Program (Z201100006820064)
- Beijing Nova Program (Z201100006820087)
- Beijing Nova Program (Z211100002121165)
- National Key Research and Development Program of China (2020YFC2004800)
- National Key Research and Development Program of China (2020YFC2004804)
- National Key Research and Development Program of China (2022YFC2505600)
This publication has 50 references indexed in Scilit:
- Whole Heart 3D Shape Reconstruction from Sparse Views: Leveraging Cardiac Computed Tomography for Cardiovascular Magnetic Resonance2023
- Slice-Mask Based 3D Cardiac Shape Reconstruction from CT Volume2023
- DeepRecon: Joint 2D Cardiac Segmentation and 3D Volume Reconstruction via a Structure-Specific Generative Method2022
- Point2Mesh-Net: Combining Point Cloud and Mesh-Based Deep Learning for Cardiac Shape Reconstruction2022
- Distortion Energy for Deep Learning-Based Volumetric Finite Element Mesh Generation for Aortic Valves2021
- Probabilistic 3D Surface Reconstruction from Sparse MRI Information2020
- Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images2018
- Isotropic 3D cardiac cine MRI allows efficient sparse segmentation strategies based on 3D surface reconstructionMagnetic Resonance in Medicine, 2017
- Correction of Slice Misalignment in Multi-breath-hold Cardiac MRI Scans2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015