Microscopic Hematological Image Classification with Captions Using Few-Shot Learning in Data-Scarce Environments
Authors:
- 28 November 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 184-190
Abstract
Recent advancements in vision-language models (VLMs) have opened new possibilities for few-shot learning in medical image analysis. This study explores the application of VLMs for microscopic blood cell image classification using descriptive captions. We investigate the performance of open-source models like CLIP, PLIP, and BiomedCLIP on this task, focusing on prompt engineering techniques and their impact on classification accuracy. Our experiments show that Biomed-CLIP consistently outperforms other models in few-shot learning scenarios, delivering superior results using only 10% of the training data, compared to traditional CNN-based approaches that require 70% to 80% of the training data to achieve similar performance. While BiomedCLIP showed lower accuracy in zero-shot learning, it demonstrated substantial improvements in few-shot settings. By leveraging contextual prompts, our approach effectively classifies both normal and malignant blood cells across various categories. These findings suggest that few-shot learning with VLMs can mitigate data scarcity issues in hematological image analysis, providing a promising methodology for early diagnosis and treatment of hematological disorders.Keywords
This publication has 27 references indexed in Scilit:
- PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning2024
- Diagnostic accuracy of vision-language models on Japanese diagnostic radiology, nuclear medicine, and interventional radiology specialty board examinationsJapanese Journal of Radiology, 2024
- Efficient leukocytes detection and classification in microscopic blood images using convolutional neural network coupled with a dual attention networkComputers in Biology and Medicine, 2024
- Bio-net dataset: AI-based diagnostic solutions using peripheral blood smear imagesBlood Cells, Molecules, and Diseases, 2024
- MetaMed: Few-shot medical image classification using gradient-based meta-learningPattern Recognition, 2021
- A fast and efficient CNN model for B‐ALL diagnosis and its subtypes classification using peripheral blood smear imagesInternational Journal of Intelligent Systems, 2021
- Red Blood Cell Classification Using Image Processing and CNNSN Computer Science, 2021
- A dataset of microscopic peripheral blood cell images for development of automatic recognition systemsData in Brief, 2020
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- Predicting Semantic Descriptions from Medical Images with Convolutional Neural Networks2015