Chen Zhao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Chen Zhao has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Weihua Zhou
Michigan Technological University
3 shared publications - Zhuo He
Department of Applied Computing, Michigan Technological University, Houghton, USA
3 shared publications - Chaoyang Zhang
School of Computing Sciences and Computer Engineering, University of Southern Mississippi, Hattiesburg, MS 39402, USA
2 shared publications - Haipeng Tang
School of Computing Sciences and Computer Engineering University of Southern Mississippi 39406 Hattiesburg MS USA
2 shared publications - Robert M. Bober
Center for Healthcare Innovation, Sutter Health, San Francisco, CA
2 shared publications - Amalia Peix
Sección de Medicina Nuclear, Instituto de Cardiología y Cirugía Cardiovascular, La Habana, Cuba
1 shared publication
Latest Publications
- Open Access
- 18 January 2024
- Published by Michigan Technological University
Deep Learning for Medical Image Segmentation using Prior Knowledge and Topology
Image segmentation refers to the division of a digital image into distinct segments or groups of pixels/voxels. However, most of the existing deep learning approaches lack the utilization of prior knowledge, such as shape information, which could improve segmentation accuracy. In addition, conventional image segmentation frequently falls short in preserving intricate spatial details, motivating the innovation of strategies for multi-scaled feature integration. Furthermore, traditional image segmentation methods primarily concentrate on pixel-level or region-level analysis. However, given the inherent morphological similarities among various image objects, the significance of topology information surpasses that of pixel-level data in the realm of medical image semantic segmentation, and the incorporation of topology information for image segmentation is important. The first aim of this dissertation is to incorporate shape priors into medical image segmentation. A shape-prior-V-Net (SP-V-Net) is proposed, which contains a shape transformation module to refine the segmentation results according to the shape prior. SP-V-Net has been applied to lung segmentation and proximal femur segmentation. The second aim aims to improve image segmentation by leveraging hierarchical features. Two approaches are proposed: the feature pyramid U-Net++ (FP-U-Net++), which dynamically aggregates the feature pyramid in the decoder of U-Net ++, and the multi-input multi-scale U-Net (MIMS U-Net), which integrates the features in the encoder of the U-Net. The third aim explores topology-based image semantic segmentation using graph neural networks. Three graph-matching networks have been developed, including association graph-based, edge attention graph matching, and hyper-association graph matching networks. The proposed graph-matching networks convert the graph-matching problems into a vertex classification problem using an association graph, where the positive vertex indicates the nodes from two individual graphs are matched. These models were applied to coronary artery semantic labeling on invasive coronary angiograms. Moreover, this study presents a pioneering approach for topology-based image semantic labeling using graph matching. The successful completion of these aims contributes technically accurate and clinically applicable algorithms and techniques for medical image segmentation. The outcomes of this dissertation provide valuable tools for the medical imaging and computer vision communities, advancing the field and improving patient care through accurate and efficient medical image segmentation.
- 18 January 2024
- Published by Michigan Technological University
Open AccessDeep Learning for Medical Image Segmentation using Prior Knowledge and Topology
Image segmentation refers to the division of a digital image into distinct segments or groups of pixels/voxels. However, most of the existing deep learning approaches lack the utilization of prior knowledge, such as shape information, which could improve segmentation accuracy. In addition, conventional image segmentation frequently falls short in preserving intricate spatial details, motivating the innovation of strategies for multi-scaled feature integration. Furthermore, traditional image segmentation methods primarily concentrate on pixel-level or region-level analysis. However, given the inherent morphological similarities among various image objects, the significance of topology information surpasses that of pixel-level data in the realm of medical image semantic segmentation, and the incorporation of topology information for image segmentation is important. The first aim of this dissertation is to incorporate shape priors into medical image segmentation. A shape-prior-V-Net (SP-V-Net) is proposed, which contains a shape transformation module to refine the segmentation results according to the shape prior. SP-V-Net has been applied to lung segmentation and proximal femur segmentation. The second aim aims to improve image segmentation by leveraging hierarchical features. Two approaches are proposed: the feature pyramid U-Net++ (FP-U-Net++), which dynamically aggregates the feature pyramid in the decoder of U-Net ++, and the multi-input multi-scale U-Net (MIMS U-Net), which integrates the features in the encoder of the U-Net. The third aim explores topology-based image semantic segmentation using graph neural networks. Three graph-matching networks have been developed, including association graph-based, edge attention graph matching, and hyper-association graph matching networks. The proposed graph-matching networks convert the graph-matching problems into a vertex classification problem using an association graph, where the positive vertex indicates the nodes from two individual graphs are matched. These models were applied to coronary artery semantic labeling on invasive coronary angiograms. Moreover, this study presents a pioneering approach for topology-based image semantic labeling using graph matching. The successful completion of these aims contributes technically accurate and clinically applicable algorithms and techniques for medical image segmentation. The outcomes of this dissertation provide valuable tools for the medical imaging and computer vision communities, advancing the field and improving patient care through accurate and efficient medical image segmentation.
- Open Access
A new method using deep learning to predict the response to cardiac resynchronization therapy
Background. Clinical parameters measured from gated single-photon emission computed tomography myocardial perfusion imaging (SPECT MPI) have value in predicting cardiac resynchronization therapy (CRT) patient outcomes, but still show limitations. The purpose of this study is to combine clinical variables, features from electrocardiogram (ECG), and parameters from assessment of cardiac function with polarmaps from gated SPECT MPI through deep learning (DL) to predict CRT response. Methods. 218 patients who underwent rest gated SPECT MPI were enrolled in this study. CRT response was defined as an increase in left ventricular ejection fraction (LVEF) > 5% at a 6-month follow up. A DL model was constructed by combining a pre-trained VGG16 module and a multilayer perceptron. Two modalities of data were input to the model: polarmap images from SPECT MPI and tabular data from clinical features and ECG parameters. Gradient-weighted Class Activation Mapping (Grad-CAM) was applied to the VGG16 module to provide explainability for the polarmaps. For comparison, four machine learning (ML) models were trained using only the tabular features. Results. Modeling was performed on 218 patients who underwent CRT implantation with a response rate of 55.5% (n = 121). The DL model demonstrated average AUC (0.83), accuracy (0.73), sensitivity (0.76), and specificity (0.69) surpassing the ML models and guideline criteria. Guideline recommendations presented accuracy (0.53), sensitivity (0.75), and specificity (0.26). Conclusions. The DL model outperformed the ML models, showcasing the additional predictive benefit of utilizing SPECT MPI polarmaps. Incorporating additional patient data directly in the form of medical imagery can improve CRT response prediction.
Open AccessA new method using deep learning to predict the response to cardiac resynchronization therapy
Background. Clinical parameters measured from gated single-photon emission computed tomography myocardial perfusion imaging (SPECT MPI) have value in predicting cardiac resynchronization therapy (CRT) patient outcomes, but still show limitations. The purpose of this study is to combine clinical variables, features from electrocardiogram (ECG), and parameters from assessment of cardiac function with polarmaps from gated SPECT MPI through deep learning (DL) to predict CRT response. Methods. 218 patients who underwent rest gated SPECT MPI were enrolled in this study. CRT response was defined as an increase in left ventricular ejection fraction (LVEF) > 5% at a 6-month follow up. A DL model was constructed by combining a pre-trained VGG16 module and a multilayer perceptron. Two modalities of data were input to the model: polarmap images from SPECT MPI and tabular data from clinical features and ECG parameters. Gradient-weighted Class Activation Mapping (Grad-CAM) was applied to the VGG16 module to provide explainability for the polarmaps. For comparison, four machine learning (ML) models were trained using only the tabular features. Results. Modeling was performed on 218 patients who underwent CRT implantation with a response rate of 55.5% (n = 121). The DL model demonstrated average AUC (0.83), accuracy (0.73), sensitivity (0.76), and specificity (0.69) surpassing the ML models and guideline criteria. Guideline recommendations presented accuracy (0.53), sensitivity (0.75), and specificity (0.26). Conclusions. The DL model outperformed the ML models, showcasing the additional predictive benefit of utilizing SPECT MPI polarmaps. Incorporating additional patient data directly in the form of medical imagery can improve CRT response prediction.
- Open Access
3D Fusion between Fluoroscopy Angiograms and SPECT Myocardial Perfusion Images to Guide Percutaneous Coronary Intervention
Background. Percutaneous coronary intervention(PCI) in stable coronary artery disease(CAD) is commonly triggered by abnormal myocardial perfusion imaging(MPI). However, due to the possibilities of multivessel disease and variability of coronary artery perfusion distribution, opportunity exists to better align anatomic stenosis with perfusion abnormalities to improve revascularization decisions. This study aims to develop a 3D multi-modality fusion approach to assist decision-making for PCI. Methods. Coronary arteries from fluoroscopic angiography(FA) were reconstructed into 3D artery anatomy. Left ventricular(LV) epicardial surface was extracted from SPECT. The 3D artery anatomy was non-rigidly fused with the LV epicardial surface. The accuracy of the 3D fusion was evaluated via both computer simulation and real patient data. For technical validation, simulated FA and MPI were integrated and then compared with the ground truth from a digital phantom. For clinical validation, FA and SPECT images were integrated and then compared with the ground truth from CT angiograms. Results. In the technical evaluation, the distance-based mismatch error between simulated fluoroscopy and phantom arteries is 1.86(SD:1.43)mm for left coronary arteries(LCA) and 2.21(SD:2.50)mm for right coronary arteries(RCA). In the clinical validation, the distance-based mismatch errors between the fluoroscopy and CT arteries were 3.84(SD:3.15)mm for LCA and 5.55(SD:3.64)mm for RCA. The presence of the corresponding fluoroscopy and CT arteries in the AHA 17-segment model agreed well with a Kappa value of 0.91(95% CI: 0.89-0.93) for LCA and 0.80(CI: 0.67-0.92) for RCA. Conclusions. Our fusion approach is technically accurate to assist PCI decision-making and is clinically feasible to be used in the catheterization laboratory. There is an opportunity to improve the decision-making and outcomes of PCI in stable CAD.
Open Access3D Fusion between Fluoroscopy Angiograms and SPECT Myocardial Perfusion Images to Guide Percutaneous Coronary Intervention
Background. Percutaneous coronary intervention(PCI) in stable coronary artery disease(CAD) is commonly triggered by abnormal myocardial perfusion imaging(MPI). However, due to the possibilities of multivessel disease and variability of coronary artery perfusion distribution, opportunity exists to better align anatomic stenosis with perfusion abnormalities to improve revascularization decisions. This study aims to develop a 3D multi-modality fusion approach to assist decision-making for PCI. Methods. Coronary arteries from fluoroscopic angiography(FA) were reconstructed into 3D artery anatomy. Left ventricular(LV) epicardial surface was extracted from SPECT. The 3D artery anatomy was non-rigidly fused with the LV epicardial surface. The accuracy of the 3D fusion was evaluated via both computer simulation and real patient data. For technical validation, simulated FA and MPI were integrated and then compared with the ground truth from a digital phantom. For clinical validation, FA and SPECT images were integrated and then compared with the ground truth from CT angiograms. Results. In the technical evaluation, the distance-based mismatch error between simulated fluoroscopy and phantom arteries is 1.86(SD:1.43)mm for left coronary arteries(LCA) and 2.21(SD:2.50)mm for right coronary arteries(RCA). In the clinical validation, the distance-based mismatch errors between the fluoroscopy and CT arteries were 3.84(SD:3.15)mm for LCA and 5.55(SD:3.64)mm for RCA. The presence of the corresponding fluoroscopy and CT arteries in the AHA 17-segment model agreed well with a Kappa value of 0.91(95% CI: 0.89-0.93) for LCA and 0.80(CI: 0.67-0.92) for RCA. Conclusions. Our fusion approach is technically accurate to assist PCI decision-making and is clinically feasible to be used in the catheterization laboratory. There is an opportunity to improve the decision-making and outcomes of PCI in stable CAD.
- Open Access
Semantic Segmentation to Extract Coronary Arteries in Invasive Coronary Angiograms
Coronary artery disease (CAD) is the leading cause of death worldwide, constituting more than one-fourth of global mortalities every year. Accurate semantic segmentation of each artery using invasive coronary angiography (ICA) is important for stenosis assessment and CAD diagnosis. However, due to the morphological similarity among different types of arteries, it is challenging for deep-learning-based models to generate semantic segmentation with an end-to-end approach. In this paper, we propose a multi-step semantic segmentation algorithm based on the analysis of arterial segments extracted from ICAs. The proposed algorithm firstly extracts the entire arterial binary mask (binary vascular tree) using a deep learning-based method. Then we extract the centerline of the binary vascular tree and separate it into different arterial segments. Finally, by extracting the underlying arterial topology, position and pixel features, we construct a powerful coronary artery segment classifier based on support vector machine. Each arterial segment is classified into left coronary artery (LCA), left anterior descending (LAD) and other types of arterial segments. We tested the proposed method on a dataset with 225 ICAs and achieved artery classification accuracy of 70.33%. The experimental results show the effectiveness of the proposed algorithm, which provides impressive performance for analyzing the individual arteries in ICAs.
Open AccessSemantic Segmentation to Extract Coronary Arteries in Invasive Coronary Angiograms
Coronary artery disease (CAD) is the leading cause of death worldwide, constituting more than one-fourth of global mortalities every year. Accurate semantic segmentation of each artery using invasive coronary angiography (ICA) is important for stenosis assessment and CAD diagnosis. However, due to the morphological similarity among different types of arteries, it is challenging for deep-learning-based models to generate semantic segmentation with an end-to-end approach. In this paper, we propose a multi-step semantic segmentation algorithm based on the analysis of arterial segments extracted from ICAs. The proposed algorithm firstly extracts the entire arterial binary mask (binary vascular tree) using a deep learning-based method. Then we extract the centerline of the binary vascular tree and separate it into different arterial segments. Finally, by extracting the underlying arterial topology, position and pixel features, we construct a powerful coronary artery segment classifier based on support vector machine. Each arterial segment is classified into left coronary artery (LCA), left anterior descending (LAD) and other types of arterial segments. We tested the proposed method on a dataset with 225 ICAs and achieved artery classification accuracy of 70.33%. The experimental results show the effectiveness of the proposed algorithm, which provides impressive performance for analyzing the individual arteries in ICAs.