Juan He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Juan He has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Bokai Yang
Institute of Intelligence Science and Engineering, Shenzhen Polytechnic University, No. 4089 Shahe West Road, Shenzhen, China
1 shared publication - Chun Lung Philip Chen
South China University of Technology
1 shared publication - Jikui Liu
Institute of Intelligence Science and Engineering, Shenzhen Polytechnic University, No. 4089 Shahe West Road, Shenzhen, China
1 shared publication - Limai Jiang
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Avenue, Shenzhen University Town, Shenzhen, 518000, China
1 shared publication - Long Chen
University of Macau
1 shared publication - Ruitao Xie
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Avenue, Shenzhen University Town, Shenzhen, 518000, China
1 shared publication
Latest Publications
- Open Access
- 14 May 2026
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 14 (1) , e78949
Multimodal Fusion of Echocardiogram Images and Electronic Medical Records for Heart Disease Screening: Retrospective Algorithm Development and Validation Study
Background: Echocardiography is a fundamental imaging modality for the diagnosis of heart disease (HD), but its interpretation remains operator-dependent and lacks standardized, data-driven decision support. Although artificial intelligence has improved image-based diagnosis, the added value and interpretability of integrating routinely collected electronic medical records (EMRs) with echocardiogram (ECHO) for large-scale screening remain underexplored. Objective: This study aims to develop an explainable artificial intelligence framework that integrates multimodal data, including ECHO images and EMRs, with derived temporal and clinical features, to enhance the screening and interpretability of heart disease diagnosis. Methods: In this retrospective single-center study, we analyzed 26,936 patients with linked ECHO and EMR records (1470 with clinically confirmed HD and 25,466 without). We constructed cross-sectional EMR features (demographics, comorbidities, and registration history) and extracted view-specific image features with a simplified Inception-v3 backbone. Five modality-specific feature vectors (4 imaging views + EMR) were concatenated and input to an extreme gradient boosting classifier within a patient-level stratified 5-fold cross-validation framework. To mitigate class imbalance during training, non-HD cases in the training folds were randomly downsampled to a 1:3 HD:non-HD ratio; held-out test folds preserved the original prevalence. Post hoc explainability was provided via Grad-CAM heatmaps for images and Shapley additive explanations analysis for EMR features. Results: For the primary binary task (presence vs absence of HD), the multimodal model achieved an AUC of 0.8147 (SD 0.009) on held-out test folds, compared with 0.7785 (SD 0.014) for the image-only baseline, and 0.7343 (SD 0.009) for the EMR-only baseline. At the clinically selected decision threshold, sensitivity, specificity, positive predictive value, and negative predictive value were 84.6% (SD 1.6%), 72.4% (SD 2%), 15% (SD 2.3%), 98.8% (SD 0.3%) for the multimodal model, versus 82.3% (SD 1.9%), 73.5% (SD 2%), 15.2% (SD 2.1%), 98.6% (SD 0.3%) (image-only), and 77.5% (SD 2.1%), 67% (SD 2.3%), 11.9% (SD 1.7%), 98.1% (SD 0.4%) (EMR-only). Grad-CAM visualizations qualitatively highlighted anatomically and physiologically meaningful regions (eg, valvular structures and abnormal flow jets), while Shapley additive explanations analysis identified age, registration years, sex, and hypertension among the top EMR contributors—findings that align with established cardiovascular risk factors. Conclusions: Integrating echocardiographic images and EMR data in an explainable multimodal framework yields improved and clinically plausible screening performance for heart disease. Future work should focus on external multicenter validation, quantitative assessment of visual explanations against expert annotations, and prospective studies assessing clinical use and workflow integration.
- 14 May 2026
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 14 (1) , e78949
Open AccessMultimodal Fusion of Echocardiogram Images and Electronic Medical Records for Heart Disease Screening: Retrospective Algorithm Development and Validation Study
Background: Echocardiography is a fundamental imaging modality for the diagnosis of heart disease (HD), but its interpretation remains operator-dependent and lacks standardized, data-driven decision support. Although artificial intelligence has improved image-based diagnosis, the added value and interpretability of integrating routinely collected electronic medical records (EMRs) with echocardiogram (ECHO) for large-scale screening remain underexplored. Objective: This study aims to develop an explainable artificial intelligence framework that integrates multimodal data, including ECHO images and EMRs, with derived temporal and clinical features, to enhance the screening and interpretability of heart disease diagnosis. Methods: In this retrospective single-center study, we analyzed 26,936 patients with linked ECHO and EMR records (1470 with clinically confirmed HD and 25,466 without). We constructed cross-sectional EMR features (demographics, comorbidities, and registration history) and extracted view-specific image features with a simplified Inception-v3 backbone. Five modality-specific feature vectors (4 imaging views + EMR) were concatenated and input to an extreme gradient boosting classifier within a patient-level stratified 5-fold cross-validation framework. To mitigate class imbalance during training, non-HD cases in the training folds were randomly downsampled to a 1:3 HD:non-HD ratio; held-out test folds preserved the original prevalence. Post hoc explainability was provided via Grad-CAM heatmaps for images and Shapley additive explanations analysis for EMR features. Results: For the primary binary task (presence vs absence of HD), the multimodal model achieved an AUC of 0.8147 (SD 0.009) on held-out test folds, compared with 0.7785 (SD 0.014) for the image-only baseline, and 0.7343 (SD 0.009) for the EMR-only baseline. At the clinically selected decision threshold, sensitivity, specificity, positive predictive value, and negative predictive value were 84.6% (SD 1.6%), 72.4% (SD 2%), 15% (SD 2.3%), 98.8% (SD 0.3%) for the multimodal model, versus 82.3% (SD 1.9%), 73.5% (SD 2%), 15.2% (SD 2.1%), 98.6% (SD 0.3%) (image-only), and 77.5% (SD 2.1%), 67% (SD 2.3%), 11.9% (SD 1.7%), 98.1% (SD 0.4%) (EMR-only). Grad-CAM visualizations qualitatively highlighted anatomically and physiologically meaningful regions (eg, valvular structures and abnormal flow jets), while Shapley additive explanations analysis identified age, registration years, sex, and hypertension among the top EMR contributors—findings that align with established cardiovascular risk factors. Conclusions: Integrating echocardiographic images and EMR data in an explainable multimodal framework yields improved and clinically plausible screening performance for heart disease. Future work should focus on external multicenter validation, quantitative assessment of visual explanations against expert annotations, and prospective studies assessing clinical use and workflow integration.
- 31 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Spatially Enhanced Refined Classifier for Cross-Scene Hyperspectral Image Classification
Conventional models for hyperspectral image (HSI) classification usually demand a substantial quantity of labeled training data. However, when labeled training HSIs are unavailable or have different distributions from test HSIs, many classification models tend to exhibit significant performance declines. For the cross-scene HSI classification task, unsupervised domain adaptation (UDA) technique has been widely developed. Existing discrepancy-based or adversarial-based UDA methods may fail to learn discriminative class boundaries when large class distribution shift (CDS) exists. To alleviate this limitation, we propose the model named Spatially Enhanced Refined Classifier (SERC), which includes a coarse classifier and a refined classifier. The refined classifier constructs a memory module to fuse global-spatial and spectral information simultaneously, and employs the neighborhood aggregation technique to generate the refined predictions. The refined predictions are then transferred to pseudo-labels to train the coarse classifier. Thereby, a mutually reinforcing relationship between the two classifiers is established. Furthermore, we propose the Class Distribution Match (CDM) strategy to further alleviate the serious CDS problem. Notably, SERC doesn’t require additional training parameters, which are commonly employed in existing UDA methods. Despite its simplicity, SERC achieves outstanding results. Our method has been extensively evaluated on three public HSI datasets and has shown superior performance compared to state-of-the-art (SOTA) approaches. The source code can be found at https://github.com/Wangzs0228/SERC.
- 31 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Spatially Enhanced Refined Classifier for Cross-Scene Hyperspectral Image Classification
Conventional models for hyperspectral image (HSI) classification usually demand a substantial quantity of labeled training data. However, when labeled training HSIs are unavailable or have different distributions from test HSIs, many classification models tend to exhibit significant performance declines. For the cross-scene HSI classification task, unsupervised domain adaptation (UDA) technique has been widely developed. Existing discrepancy-based or adversarial-based UDA methods may fail to learn discriminative class boundaries when large class distribution shift (CDS) exists. To alleviate this limitation, we propose the model named Spatially Enhanced Refined Classifier (SERC), which includes a coarse classifier and a refined classifier. The refined classifier constructs a memory module to fuse global-spatial and spectral information simultaneously, and employs the neighborhood aggregation technique to generate the refined predictions. The refined predictions are then transferred to pseudo-labels to train the coarse classifier. Thereby, a mutually reinforcing relationship between the two classifiers is established. Furthermore, we propose the Class Distribution Match (CDM) strategy to further alleviate the serious CDS problem. Notably, SERC doesn’t require additional training parameters, which are commonly employed in existing UDA methods. Despite its simplicity, SERC achieves outstanding results. Our method has been extensively evaluated on three public HSI datasets and has shown superior performance compared to state-of-the-art (SOTA) approaches. The source code can be found at https://github.com/Wangzs0228/SERC.