Chengyin Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Chengyin Li has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Dongxiao Zhu
Wayne State University
5 shared publications Hui Zhu
Wayne State University
2 shared publications- Prashant Khanduri
Wayne State University
2 shared publications - Rafi Ibn Sultan
Wayne State University
2 shared publications - Dong Chen
Department of Materials Science and Engineering, City University of Hong Kong, Hong Kong SAR 999077, China
1 shared publication Hassan Bagher Ebadian
Henry Ford Health
1 shared publication
Latest Publications
- Open Access
BiPVL-Seg: Bidirectional Progressive Vision-Language Fusion with Global-Local Alignment for Medical Image Segmentation
Medical image segmentation typically relies solely on visual data, overlooking the rich textual information clinicians use for diagnosis. Vision-language models attempt to bridge this gap, but existing approaches often process visual and textual features independently, resulting in weak cross-modal alignment. Simple fusion techniques fail due to the inherent differences between spatial visual features and sequential text embeddings. Additionally, medical terminology deviates from general language, limiting the effectiveness of off-the-shelf text encoders and further hindering vision-language alignment. We propose BiPVL-Seg, an end-to-end framework that integrates vision-language fusion and embedding alignment through architectural and training innovations, where both components reinforce each other to enhance medical image segmentation. BiPVL-Seg introduces bidirectional progressive fusion in the architecture, which facilitates stage-wise information exchange between vision and text encoders. Additionally, it incorporates global-local contrastive alignment, a training objective that enhances the text encoder's comprehension by aligning text and vision embeddings at both class and concept levels. Extensive experiments on diverse medical imaging benchmarks across CT and MR modalities demonstrate BiPVL-Seg's superior performance when compared with state-of-the-art methods in complex multi-class segmentation. Source code is available in this GitHub repository.
Open AccessBiPVL-Seg: Bidirectional Progressive Vision-Language Fusion with Global-Local Alignment for Medical Image Segmentation
Medical image segmentation typically relies solely on visual data, overlooking the rich textual information clinicians use for diagnosis. Vision-language models attempt to bridge this gap, but existing approaches often process visual and textual features independently, resulting in weak cross-modal alignment. Simple fusion techniques fail due to the inherent differences between spatial visual features and sequential text embeddings. Additionally, medical terminology deviates from general language, limiting the effectiveness of off-the-shelf text encoders and further hindering vision-language alignment. We propose BiPVL-Seg, an end-to-end framework that integrates vision-language fusion and embedding alignment through architectural and training innovations, where both components reinforce each other to enhance medical image segmentation. BiPVL-Seg introduces bidirectional progressive fusion in the architecture, which facilitates stage-wise information exchange between vision and text encoders. Additionally, it incorporates global-local contrastive alignment, a training objective that enhances the text encoder's comprehension by aligning text and vision embeddings at both class and concept levels. Extensive experiments on diverse medical imaging benchmarks across CT and MR modalities demonstrate BiPVL-Seg's superior performance when compared with state-of-the-art methods in complex multi-class segmentation. Source code is available in this GitHub repository.
- 2 December 2024
- Published by Springer Nature
- p. 358-376
Fairness-Aware Vision Transformer via Debiased Self-Attention
- 2 December 2024
- Published by Springer Nature
- p. 358-376
Fairness-Aware Vision Transformer via Debiased Self-Attention
- Open Access
MulModSeg: Enhancing Unpaired Multi-Modal Medical Image Segmentation with Modality-Conditioned Text Embedding and Alternating Training
In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This heterogeneity challenges automatic segmentation algorithms to maintain consistent performance across different modalities due to the requirement for spatially aligned and paired images. Typically, segmentation models are trained using a single modality, which limits their ability to generalize to other types of input data without employing transfer learning techniques. Additionally, leveraging complementary information from different modalities to enhance segmentation precision often necessitates substantial modifications to popular encoder-decoder designs, such as introducing multiple branched encoding or decoding paths for each modality. In this work, we propose a simple Multi-Modal Segmentation (MulModSeg) strategy to enhance medical image segmentation across multiple modalities, specifically CT and MR. It incorporates two key designs: a modality-conditioned text embedding framework via a frozen text encoder that adds modality awareness to existing segmentation frameworks without significant structural modifications or computational overhead, and an alternating training procedure that facilitates the integration of essential features from unpaired CT and MR inputs. Through extensive experiments with both Fully Convolutional Network and Transformer-based backbones, MulModSeg consistently outperforms previous methods in segmenting abdominal multi-organ and cardiac substructures for both CT and MR modalities. The code is available in this {\href{https://github.com/ChengyinLee/MulModSeg_2024}{link}}.
Open AccessMulModSeg: Enhancing Unpaired Multi-Modal Medical Image Segmentation with Modality-Conditioned Text Embedding and Alternating Training
In the diverse field of medical imaging, automatic segmentation has numerous applications and must handle a wide variety of input domains, such as different types of Computed Tomography (CT) scans and Magnetic Resonance (MR) images. This heterogeneity challenges automatic segmentation algorithms to maintain consistent performance across different modalities due to the requirement for spatially aligned and paired images. Typically, segmentation models are trained using a single modality, which limits their ability to generalize to other types of input data without employing transfer learning techniques. Additionally, leveraging complementary information from different modalities to enhance segmentation precision often necessitates substantial modifications to popular encoder-decoder designs, such as introducing multiple branched encoding or decoding paths for each modality. In this work, we propose a simple Multi-Modal Segmentation (MulModSeg) strategy to enhance medical image segmentation across multiple modalities, specifically CT and MR. It incorporates two key designs: a modality-conditioned text embedding framework via a frozen text encoder that adds modality awareness to existing segmentation frameworks without significant structural modifications or computational overhead, and an alternating training procedure that facilitates the integration of essential features from unpaired CT and MR inputs. Through extensive experiments with both Fully Convolutional Network and Transformer-based backbones, MulModSeg consistently outperforms previous methods in segmenting abdominal multi-organ and cardiac substructures for both CT and MR modalities. The code is available in this {\href{https://github.com/ChengyinLee/MulModSeg_2024}{link}}.
- Open Access
- 18 June 2021
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Heterogeneous network selection strategy based on power wireless communication system
In the power communication network, a network selection algorithm based on QoS guarantee of power service is proposed for the heterogeneous multi network mixed coexistence scenarios composed of 230MHz wireless private network, 1800MHz wireless private network, WLAN, WiMAX and 5G public network. Firstly, QoS parameters are selected and classified according to the network performance and power service demand index; Secondly, the subjective weight and objective weight are obtained respectively based on the analytic hierarchy process and the improved entropy weight method, and the subjective and objective weights are balanced by game theory; Finally, the multi-attribute decision theory is used to select wireless network access which can meet the QoS requirements of power service and the best performance. The simulation results show that the algorithm can effectively guarantee the QoS of power service, and realize the reasonable allocation of access network resources, balance the load and improve the utilization of resources.
- 18 June 2021
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessHeterogeneous network selection strategy based on power wireless communication system
In the power communication network, a network selection algorithm based on QoS guarantee of power service is proposed for the heterogeneous multi network mixed coexistence scenarios composed of 230MHz wireless private network, 1800MHz wireless private network, WLAN, WiMAX and 5G public network. Firstly, QoS parameters are selected and classified according to the network performance and power service demand index; Secondly, the subjective weight and objective weight are obtained respectively based on the analytic hierarchy process and the improved entropy weight method, and the subjective and objective weights are balanced by game theory; Finally, the multi-attribute decision theory is used to select wireless network access which can meet the QoS requirements of power service and the best performance. The simulation results show that the algorithm can effectively guarantee the QoS of power service, and realize the reasonable allocation of access network resources, balance the load and improve the utilization of resources.
- Open Access
COVID-MobileXpert: On-Device COVID-19 Patient Triage and Follow-up using Chest X-rays
During the COVID-19 pandemic, there has been an emerging need for rapid, dedicated, and point-of-care COVID-19 patient disposition techniques to optimize resource utilization and clinical workflow. In view of this need, we present COVID-MobileXpert: a lightweight deep neural network (DNN) based mobile app that can use chest X-ray (CXR) for COVID-19 case screening and radiological trajectory prediction. We design and implement a novel three-player knowledge transfer and distillation (KTD) framework including a pre-trained attending physician (AP) network that extracts CXR imaging features from a large scale of lung disease CXR images, a fine-tuned resident fellow (RF) network that learns the essential CXR imaging features to discriminate COVID-19 from pneumonia and/or normal cases with a small amount of COVID-19 cases, and a trained lightweight medical student (MS) network to perform on-device COVID-19 patient triage and follow-up. To tackle the challenge of vastly similar and dominant fore- and background in medical images, we employ novel loss functions and training schemes for the MS network to learn the robust features. We demonstrate the significant potential of COVID-MobileXpert for rapid deployment via extensive experiments with diverse MS architecture and tuning parameter settings. The source codes for cloud and mobile based models are available from the following url: https://github.com/xinli0928/COVID-Xray.
Open AccessCOVID-MobileXpert: On-Device COVID-19 Patient Triage and Follow-up using Chest X-rays
During the COVID-19 pandemic, there has been an emerging need for rapid, dedicated, and point-of-care COVID-19 patient disposition techniques to optimize resource utilization and clinical workflow. In view of this need, we present COVID-MobileXpert: a lightweight deep neural network (DNN) based mobile app that can use chest X-ray (CXR) for COVID-19 case screening and radiological trajectory prediction. We design and implement a novel three-player knowledge transfer and distillation (KTD) framework including a pre-trained attending physician (AP) network that extracts CXR imaging features from a large scale of lung disease CXR images, a fine-tuned resident fellow (RF) network that learns the essential CXR imaging features to discriminate COVID-19 from pneumonia and/or normal cases with a small amount of COVID-19 cases, and a trained lightweight medical student (MS) network to perform on-device COVID-19 patient triage and follow-up. To tackle the challenge of vastly similar and dominant fore- and background in medical images, we employ novel loss functions and training schemes for the MS network to learn the robust features. We demonstrate the significant potential of COVID-MobileXpert for rapid deployment via extensive experiments with diverse MS architecture and tuning parameter settings. The source codes for cloud and mobile based models are available from the following url: https://github.com/xinli0928/COVID-Xray.
- 1 October 2015
- Published by Elsevier in Colloids and Surfaces A: Physicochemical and Engineering Aspects
- Vol. 482, 386-393
Effect of ionic liquid on the synthesis and electrocatalytic property of platinum-based bimetallic nanoparticles
- 1 October 2015
- Published by Elsevier in Colloids and Surfaces A: Physicochemical and Engineering Aspects
- Vol. 482, 386-393
Effect of ionic liquid on the synthesis and electrocatalytic property of platinum-based bimetallic nanoparticles