Xiaolu Chen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Xiaolu Chen has a total of 2 co-authors. Here are the top co-authors by number of shared publications:
- Li Jiao
School of Information and Communication Engineering, Communication University of China, Beijing 100024, China
1 shared publication - Wenlong Fu
State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China
1 shared publication
Latest Publications
- Open Access
- 10 March 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15 (6) , 2966
Image–Text (IT)-Prompt: Prompt-Based Learning Framework Empowered by the Cluster-Based Nearest Class Mean (C-NCM) for Rehearsal-Free Contrastive Language–Image Pretraining (CLIP)-Based Continual Learning
The Contrastive Language–Image Pretraining (CLIP) model has demonstrated remarkable zero-shot capabilities through contrastive learning on large-scale text-image datasets, sparking interest in developing continuous learning methods to extend its knowledge while preserving zero-shot performance. However, traditional approaches often modify the pretrained parameters of CLIP, compromising its zero-shot capabilities, and face challenges due to the substantial parameter size of CLIP and lengthy training times. To address these issues, we propose the Image–Text (IT-)Prompt method, which leverages the inherent correlation between visual and textual information to train discrete prompts dedicated to individual tasks, serving as repositories for task-specific knowledge. By employing discrete textual prompts as guidance, we ensure the uniqueness of each task’s prompt and prevent interference among tasks, thus alleviating catastrophic forgetting during continuous learning. While retaining the pretrained parameters of CLIP, our approach introduces only a small number of additional trainable parameters, enhancing training efficiency and preserving the original zero-shot capabilities of CLIP. Building on IT-Prompt, we further introduce a Cluster-based Nearest Class Mean classifier, which eliminates the need for Softmax classifiers to store and retrain old task samples, significantly improving training efficiency and reducing resource consumption. Experiments demonstrate that our method achieves over a 10% performance improvement compared to state-of-the-art CLIP-based continuous learning methods, with enhanced efficiency and reduced overhead.
- 10 March 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15 (6) , 2966
Open AccessImage–Text (IT)-Prompt: Prompt-Based Learning Framework Empowered by the Cluster-Based Nearest Class Mean (C-NCM) for Rehearsal-Free Contrastive Language–Image Pretraining (CLIP)-Based Continual Learning
The Contrastive Language–Image Pretraining (CLIP) model has demonstrated remarkable zero-shot capabilities through contrastive learning on large-scale text-image datasets, sparking interest in developing continuous learning methods to extend its knowledge while preserving zero-shot performance. However, traditional approaches often modify the pretrained parameters of CLIP, compromising its zero-shot capabilities, and face challenges due to the substantial parameter size of CLIP and lengthy training times. To address these issues, we propose the Image–Text (IT-)Prompt method, which leverages the inherent correlation between visual and textual information to train discrete prompts dedicated to individual tasks, serving as repositories for task-specific knowledge. By employing discrete textual prompts as guidance, we ensure the uniqueness of each task’s prompt and prevent interference among tasks, thus alleviating catastrophic forgetting during continuous learning. While retaining the pretrained parameters of CLIP, our approach introduces only a small number of additional trainable parameters, enhancing training efficiency and preserving the original zero-shot capabilities of CLIP. Building on IT-Prompt, we further introduce a Cluster-based Nearest Class Mean classifier, which eliminates the need for Softmax classifiers to store and retrain old task samples, significantly improving training efficiency and reducing resource consumption. Experiments demonstrate that our method achieves over a 10% performance improvement compared to state-of-the-art CLIP-based continuous learning methods, with enhanced efficiency and reduced overhead.