Jieru Yao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jieru Yao has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Dingwen Zhang
Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China
2 shared publications - Guangyu Guo
DAMO Academy, Alibaba group, Hangzhou, Zhejiang, China and College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, China
2 shared publications - Zhaohui Zheng
Department of Clinical Immunology Xijing Hospital, The Fourth Military Medical University Xi'an Shaanxi China
2 shared publications Jin Ding
Department of Clinical Immunology, Xijing Hospital, The Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
1 shared publicationJunwei Han
Hefei Comprehensive National Science Center, Hefei, Anhui, 230088, China
1 shared publication- Junwei Han
School of Artificial Intelligence, Chongqing University of Posts and Telecommunications, Chongqing, China
1 shared publication
Latest Publications
- 25 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 44 (11) , 4567-4578
Prompting Vision-Language Model for Nuclei Instance Segmentation and Classification
Nuclei instance segmentation and classification are a fundamental and challenging task in whole slide Imaging (WSI) analysis. Most dense nuclei prediction studies rely heavily on crowd labelled data on high-resolution digital images, leading to a time-consuming and expertise-required paradigm. Recently, Vision-Language Models (VLMs) have been intensively investigated, which learn rich cross-modal correlation from large-scale image-text pairs without tedious annotations. Inspired by this, we build a novel framework, called PromptNu, aiming at infusing abundant nuclei knowledge into the training of the nuclei instance recognition model through vision-language contrastive learning and prompt engineering techniques. Specifically, our approach starts with the creation of multifaceted prompts that integrate comprehensive nuclear knowledge, including visual insights from the GPT-4V model, statistical analyses, and expert insights from the pathology field. Then, we propose a novel prompting methodology that consists of two pivotal vision-language contrastive learning components: the Prompting Nuclei Representation Learning (PNuRL) and the Prompting Nuclei Dense Prediction (PNuDP), which adeptly integrates the expertise embedded in pre-trained VLMs and multi-faceted prompts into the feature extraction and prediction process, respectively. Comprehensive experiments on six datasets with extensive WSI scenarios demonstrate the effectiveness of our method for both nuclei instance segmentation and classification tasks. The code is available at https://github.com/NucleiDet/PromptNu.
- 25 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 44 (11) , 4567-4578
Prompting Vision-Language Model for Nuclei Instance Segmentation and Classification
Nuclei instance segmentation and classification are a fundamental and challenging task in whole slide Imaging (WSI) analysis. Most dense nuclei prediction studies rely heavily on crowd labelled data on high-resolution digital images, leading to a time-consuming and expertise-required paradigm. Recently, Vision-Language Models (VLMs) have been intensively investigated, which learn rich cross-modal correlation from large-scale image-text pairs without tedious annotations. Inspired by this, we build a novel framework, called PromptNu, aiming at infusing abundant nuclei knowledge into the training of the nuclei instance recognition model through vision-language contrastive learning and prompt engineering techniques. Specifically, our approach starts with the creation of multifaceted prompts that integrate comprehensive nuclear knowledge, including visual insights from the GPT-4V model, statistical analyses, and expert insights from the pathology field. Then, we propose a novel prompting methodology that consists of two pivotal vision-language contrastive learning components: the Prompting Nuclei Representation Learning (PNuRL) and the Prompting Nuclei Dense Prediction (PNuDP), which adeptly integrates the expertise embedded in pre-trained VLMs and multi-faceted prompts into the feature extraction and prediction process, respectively. Comprehensive experiments on six datasets with extensive WSI scenarios demonstrate the effectiveness of our method for both nuclei instance segmentation and classification tasks. The code is available at https://github.com/NucleiDet/PromptNu.
- 5 December 2023
- Published by Elsevier in Neural Networks
- Vol. 171, 159-170
Position-based anchor optimization for point supervised dense nuclei detection
- 5 December 2023
- Published by Elsevier in Neural Networks
- Vol. 171, 159-170
Position-based anchor optimization for point supervised dense nuclei detection