Michiel Schaap
Research Subjects
Michiel Schaap has a total of 51 co-authors. Here are the top co-authors by number of shared publications:
- Charles A. Taylor
Department of Computational Engineering and Sciences, University of Texas , Austin
3 shared publications - Elazer Reuven Edelman
Harvard Medical School
3 shared publications - Farhad Rikhtegar Nezami
Harvard Medical School
3 shared publications - Karim Kadry
Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, USA
3 shared publications - Kersten Petersen
HeartFlow
3 shared publications - Ben Glocker
Imperial College London
2 shared publications
Latest Publications
- Open Access
Vector Representations of Vessel Trees
We introduce a novel framework for learning vector representations of tree-structured geometric data focusing on 3D vascular networks. Our approach employs two sequentially trained Transformer-based autoencoders. In the first stage, the Vessel Autoencoder captures continuous geometric details of individual vessel segments by learning embeddings from sampled points along each curve. In the second stage, the Vessel Tree Autoencoder encodes the topology of the vascular network as a single vector representation, leveraging the segment-level embeddings from the first model. A recursive decoding process ensures that the reconstructed topology is a valid tree structure. Compared to 3D convolutional models, this proposed approach substantially lowers GPU memory requirements, facilitating large-scale training. Experimental results on a 2D synthetic tree dataset and a 3D coronary artery dataset demonstrate superior reconstruction fidelity, accurate topology preservation, and realistic interpolations in latent space. Our scalable framework, named VeTTA, offers precise, flexible, and topologically consistent modeling of anatomical tree structures in medical imaging.
Open AccessVector Representations of Vessel Trees
We introduce a novel framework for learning vector representations of tree-structured geometric data focusing on 3D vascular networks. Our approach employs two sequentially trained Transformer-based autoencoders. In the first stage, the Vessel Autoencoder captures continuous geometric details of individual vessel segments by learning embeddings from sampled points along each curve. In the second stage, the Vessel Tree Autoencoder encodes the topology of the vascular network as a single vector representation, leveraging the segment-level embeddings from the first model. A recursive decoding process ensures that the reconstructed topology is a valid tree structure. Compared to 3D convolutional models, this proposed approach substantially lowers GPU memory requirements, facilitating large-scale training. Experimental results on a 2D synthetic tree dataset and a 3D coronary artery dataset demonstrate superior reconstruction fidelity, accurate topology preservation, and realistic interpolations in latent space. Our scalable framework, named VeTTA, offers precise, flexible, and topologically consistent modeling of anatomical tree structures in medical imaging.
- 25 October 2024
- Published by Springer Nature
- p. 396-412
A Diffusion Model for Simulation Ready Coronary Anatomy with Morpho-Skeletal Control
- 25 October 2024
- Published by Springer Nature
- p. 396-412
A Diffusion Model for Simulation Ready Coronary Anatomy with Morpho-Skeletal Control
- Open Access
A Diffusion Model for Simulation Ready Coronary Anatomy with Morpho-skeletal Control
Virtual interventions enable the physics-based simulation of device deployment within coronary arteries. This framework allows for counterfactual reasoning by deploying the same device in different arterial anatomies. However, current methods to create such counterfactual arteries face a trade-off between controllability and realism. In this study, we investigate how Latent Diffusion Models (LDMs) can custom synthesize coronary anatomy for virtual intervention studies based on mid-level anatomic constraints such as topological validity, local morphological shape, and global skeletal structure. We also extend diffusion model guidance strategies to the context of morpho-skeletal conditioning and propose a novel guidance method for continuous attributes that adaptively updates the negative guiding condition throughout sampling. Our framework enables the generation and editing of coronary anatomy in a controllable manner, allowing device designers to derive mechanistic insights regarding anatomic variation and simulated device deployment.
Open AccessA Diffusion Model for Simulation Ready Coronary Anatomy with Morpho-skeletal Control
Virtual interventions enable the physics-based simulation of device deployment within coronary arteries. This framework allows for counterfactual reasoning by deploying the same device in different arterial anatomies. However, current methods to create such counterfactual arteries face a trade-off between controllability and realism. In this study, we investigate how Latent Diffusion Models (LDMs) can custom synthesize coronary anatomy for virtual intervention studies based on mid-level anatomic constraints such as topological validity, local morphological shape, and global skeletal structure. We also extend diffusion model guidance strategies to the context of morpho-skeletal conditioning and propose a novel guidance method for continuous attributes that adaptively updates the negative guiding condition throughout sampling. Our framework enables the generation and editing of coronary anatomy in a controllable manner, allowing device designers to derive mechanistic insights regarding anatomic variation and simulated device deployment.
- Top Cited PapersOpen Access
- 3 May 2024
- Published by Oxford University Press (OUP) in European Heart Journal - Cardiovascular Imaging
- Vol. 25 (9) , 1287-1295
Prospective deep learning–based quantitative assessment of coronary plaque by computed tomography angiography compared with intravascular ultrasound: the REVEALPLAQUE study
Coronary computed tomography angiography provides non-invasive assessment of coronary stenosis severity and flow impairment. Automated artificial intelligence (AI) analysis may assist in precise quantification and characterization of coronary atherosclerosis, enabling patient-specific risk determination and management strategies. This multicentre international study compared an automated deep learning-based method for segmenting coronary atherosclerosis in coronary computed tomography angiography (CCTA) against the reference standard of intravascular ultrasound (IVUS). The study included clinically stable patients with known coronary artery disease from 15 centres in the USA and Japan. An AI-enabled plaque analysis was utilized to quantify and characterize total plaque (TPV), vessel, lumen, calcified plaque (CP), non-calcified plaque (NCP), and low-attenuation plaque (LAP) volumes derived from CCTA and compared with IVUS measurements in a blinded, core laboratory-adjudicated fashion. In 237 patients, 432 lesions were assessed; mean lesion length was 24.5 mm, and mean IVUS-TPV was 186.0 mm3. AI-enabled plaque analysis on CCTA showed strong correlation and high accuracy when compared with IVUS; correlation coefficient, slope, and Y intercept for TPV were 0.91, 0.99, and 1.87, respectively; for CP volume 0.91, 1.05, and 5.32, respectively; and for NCP volume 0.87, 0.98, and 15.24, respectively. Bland–Altman analysis demonstrated strong agreement with little bias for these measurements. AI-enabled CCTA quantification and characterization of atherosclerosis demonstrated strong agreement with IVUS reference standard measurements. This tool may prove effective for accurate evaluation of coronary atherosclerotic burden and cardiovascular risk assessment. Matching cross-sectional, longitudinal, and 3D views of IVUS and CCTA show correlating presence of calcified and non-calcified plaque between the two imaging modalities. The table highlights plaque volume correlations for total plaque (TPV), calcified plaque (CP), and non-calcified plaque (NCP) on a per-lesion basis (n = 432). In the cross-sectional and longitudinal view, blue-coloured areas are calcified plaque and yellow-coloured areas are non-calcified plaque. In the 3D view, blue-coloured area is calcified plaque and yellow translucent-coloured area is non-calcified plaque.
- 3 May 2024
- Published by Oxford University Press (OUP) in European Heart Journal - Cardiovascular Imaging
- Vol. 25 (9) , 1287-1295
Top Cited PapersOpen AccessProspective deep learning–based quantitative assessment of coronary plaque by computed tomography angiography compared with intravascular ultrasound: the REVEALPLAQUE study
Coronary computed tomography angiography provides non-invasive assessment of coronary stenosis severity and flow impairment. Automated artificial intelligence (AI) analysis may assist in precise quantification and characterization of coronary atherosclerosis, enabling patient-specific risk determination and management strategies. This multicentre international study compared an automated deep learning-based method for segmenting coronary atherosclerosis in coronary computed tomography angiography (CCTA) against the reference standard of intravascular ultrasound (IVUS). The study included clinically stable patients with known coronary artery disease from 15 centres in the USA and Japan. An AI-enabled plaque analysis was utilized to quantify and characterize total plaque (TPV), vessel, lumen, calcified plaque (CP), non-calcified plaque (NCP), and low-attenuation plaque (LAP) volumes derived from CCTA and compared with IVUS measurements in a blinded, core laboratory-adjudicated fashion. In 237 patients, 432 lesions were assessed; mean lesion length was 24.5 mm, and mean IVUS-TPV was 186.0 mm3. AI-enabled plaque analysis on CCTA showed strong correlation and high accuracy when compared with IVUS; correlation coefficient, slope, and Y intercept for TPV were 0.91, 0.99, and 1.87, respectively; for CP volume 0.91, 1.05, and 5.32, respectively; and for NCP volume 0.87, 0.98, and 15.24, respectively. Bland–Altman analysis demonstrated strong agreement with little bias for these measurements. AI-enabled CCTA quantification and characterization of atherosclerosis demonstrated strong agreement with IVUS reference standard measurements. This tool may prove effective for accurate evaluation of coronary atherosclerotic burden and cardiovascular risk assessment. Matching cross-sectional, longitudinal, and 3D views of IVUS and CCTA show correlating presence of calcified and non-calcified plaque between the two imaging modalities. The table highlights plaque volume correlations for total plaque (TPV), calcified plaque (CP), and non-calcified plaque (NCP) on a per-lesion basis (n = 432). In the cross-sectional and longitudinal view, blue-coloured areas are calcified plaque and yellow-coloured areas are non-calcified plaque. In the 3D view, blue-coloured area is calcified plaque and yellow translucent-coloured area is non-calcified plaque.
- Open Access
Morphology-based non-rigid registration of coronary computed tomography and intravascular images through virtual catheter path optimization
Coronary Computed Tomography Angiography (CCTA) provides information on the presence, extent, and severity of obstructive coronary artery disease. Large-scale clinical studies analyzing CCTA-derived metrics typically require ground-truth validation in the form of high-fidelity 3D intravascular imaging. However, manual rigid alignment of intravascular images to corresponding CCTA images is both time consuming and user-dependent. Moreover, intravascular modalities suffer from several non-rigid motion-induced distortions arising from distortions in the imaging catheter path. To address these issues, we here present a semi-automatic segmentation-based framework for both rigid and non-rigid matching of intravascular images to CCTA images. We formulate the problem in terms of finding the optimal \emph{virtual catheter path} that samples the CCTA data to recapitulate the coronary artery morphology found in the intravascular image. We validate our co-registration framework on a cohort of $n=40$ patients using bifurcation landmarks as ground truth for longitudinal and rotational registration. Our results indicate that our non-rigid registration significantly outperforms other co-registration approaches for luminal bifurcation alignment in both longitudinal (mean mismatch: 3.3 frames) and rotational directions (mean mismatch: 28.6 degrees). By providing a differentiable framework for automatic multi-modal intravascular data fusion, our developed co-registration modules significantly reduces the manual effort required to conduct large-scale multi-modal clinical studies while also providing a solid foundation for the development of machine learning-based co-registration approaches.Open AccessMorphology-based non-rigid registration of coronary computed tomography and intravascular images through virtual catheter path optimization
Coronary Computed Tomography Angiography (CCTA) provides information on the presence, extent, and severity of obstructive coronary artery disease. Large-scale clinical studies analyzing CCTA-derived metrics typically require ground-truth validation in the form of high-fidelity 3D intravascular imaging. However, manual rigid alignment of intravascular images to corresponding CCTA images is both time consuming and user-dependent. Moreover, intravascular modalities suffer from several non-rigid motion-induced distortions arising from distortions in the imaging catheter path. To address these issues, we here present a semi-automatic segmentation-based framework for both rigid and non-rigid matching of intravascular images to CCTA images. We formulate the problem in terms of finding the optimal \emph{virtual catheter path} that samples the CCTA data to recapitulate the coronary artery morphology found in the intravascular image. We validate our co-registration framework on a cohort of $n=40$ patients using bifurcation landmarks as ground truth for longitudinal and rotational registration. Our results indicate that our non-rigid registration significantly outperforms other co-registration approaches for luminal bifurcation alignment in both longitudinal (mean mismatch: 3.3 frames) and rotational directions (mean mismatch: 28.6 degrees). By providing a differentiable framework for automatic multi-modal intravascular data fusion, our developed co-registration modules significantly reduces the manual effort required to conduct large-scale multi-modal clinical studies while also providing a solid foundation for the development of machine learning-based co-registration approaches. - Top Cited PapersOpen Access
- 1 April 2019
- Published by Elsevier in Medical Image Analysis
- Vol. 53, 197-207
Attention gated networks: Learning to leverage salient regions in medical images
- 1 April 2019
- Published by Elsevier in Medical Image Analysis
- Vol. 53, 197-207
Top Cited PapersOpen AccessAttention gated networks: Learning to leverage salient regions in medical images
- 15 August 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 66 (4) , 946-955
Generation of Patient-Specific Cardiac Vascular Networks: A Hybrid Image-Based and Synthetic Geometric Model
Objective: In this paper, we propose an algorithm for the generation of a patient-specific cardiac vascular network starting from segmented epicardial vessels down to the arterioles. Method: We extend a tree generation method based on satisfaction of functional principles, named Constrained Constructive Optimization (CCO), to account for multiple, competing vascular trees. The algorithm simulates angiogenesis under vascular volume minimization with flow-related and geometrical constraints adapting the simultaneous tree growths to patient priors. The generated trees fill the entire left ventricle myocardium up to the arterioles. Results: From actual vascular tree models segmented from CT images, we generated networks with 6000 terminal segments for 6 patients. These networks contain between 33 and 62 synthetic trees. All vascular models match morphometry properties previously described. Conclusion and significance: Image-based models derived from CT angiography are being used clinically to simulate blood flow in the coronary arteries of individual patients to aid in the diagnosis of disease and planning treatments. However, image resolution limits vessel segmentation to larger epicardial arteries. The generated model can be used to simulate blood flow and derived quantities from the aorta into the myocardium. This is an important step for diagnosis an treatment planning of coronary artery disease.
- 15 August 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 66 (4) , 946-955
Generation of Patient-Specific Cardiac Vascular Networks: A Hybrid Image-Based and Synthetic Geometric Model
Objective: In this paper, we propose an algorithm for the generation of a patient-specific cardiac vascular network starting from segmented epicardial vessels down to the arterioles. Method: We extend a tree generation method based on satisfaction of functional principles, named Constrained Constructive Optimization (CCO), to account for multiple, competing vascular trees. The algorithm simulates angiogenesis under vascular volume minimization with flow-related and geometrical constraints adapting the simultaneous tree growths to patient priors. The generated trees fill the entire left ventricle myocardium up to the arterioles. Results: From actual vascular tree models segmented from CT images, we generated networks with 6000 terminal segments for 6 patients. These networks contain between 33 and 62 synthetic trees. All vascular models match morphometry properties previously described. Conclusion and significance: Image-based models derived from CT angiography are being used clinically to simulate blood flow in the coronary arteries of individual patients to aid in the diagnosis of disease and planning treatments. However, image resolution limits vessel segmentation to larger epicardial arteries. The generated model can be used to simulate blood flow and derived quantities from the aorta into the myocardium. This is an important step for diagnosis an treatment planning of coronary artery disease.
- 26 April 2012
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 31 (8) , 1573-1583
Statistical Shape Model-Based Femur Kinematics From Biplane Fluoroscopy
Studying joint kinematics is of interest to improve prosthesis design and to characterize postoperative motion. State of the art techniques register bones segmented from prior computed tomography or magnetic resonance scans with X-ray fluoroscopic sequences. Elimination of the prior 3D acquisition could potentially lower costs and radiation dose. Therefore, we propose to substitute the segmented bone surface with a statistical shape model based estimate. A dedicated dynamic reconstruction and tracking algorithm was developed estimating the shape based on all frames, and pose per frame. The algorithm minimizes the difference between the projected bone contour and image edges. To increase robustness, we employ a dynamic prior, image features, and prior knowledge about bone edge appearances. This enables tracking and reconstruction from a single initial pose per sequence. We evaluated our method on the distal femur using eight biplane fluoroscopic drop-landing sequences. The proposed dynamic prior and features increased the convergence rate of the reconstruction from 71% to 91%, using a convergence limit of 3 mm. The achieved root mean square point-to-surface accuracy at the converged frames was 1.48 ± 0.41 mm.The resulting tracking precision was 1-1.5 mm, with the largest errors occurring in the rotation around the femoral shaft (about 2.5° precision).
- 26 April 2012
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 31 (8) , 1573-1583
Statistical Shape Model-Based Femur Kinematics From Biplane Fluoroscopy
Studying joint kinematics is of interest to improve prosthesis design and to characterize postoperative motion. State of the art techniques register bones segmented from prior computed tomography or magnetic resonance scans with X-ray fluoroscopic sequences. Elimination of the prior 3D acquisition could potentially lower costs and radiation dose. Therefore, we propose to substitute the segmented bone surface with a statistical shape model based estimate. A dedicated dynamic reconstruction and tracking algorithm was developed estimating the shape based on all frames, and pose per frame. The algorithm minimizes the difference between the projected bone contour and image edges. To increase robustness, we employ a dynamic prior, image features, and prior knowledge about bone edge appearances. This enables tracking and reconstruction from a single initial pose per sequence. We evaluated our method on the distal femur using eight biplane fluoroscopic drop-landing sequences. The proposed dynamic prior and features increased the convergence rate of the reconstruction from 71% to 91%, using a convergence limit of 3 mm. The achieved root mean square point-to-surface accuracy at the converged frames was 1.48 ± 0.41 mm.The resulting tracking precision was 1-1.5 mm, with the largest errors occurring in the rotation around the femoral shaft (about 2.5° precision).