Enming Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Enming Zhang has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Bingke Zhu
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China
1 shared publication - Jinqiao Wang
Chinese Academy of Sciences
1 shared publication - Ming Tang
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
1 shared publication - Qinghai Miao
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
1 shared publication - Yingying Chen
Institute of Automation, Chinese Academy of Sciences, Beijing, China
1 shared publication
Latest Publications
- 14 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 27 (15209210) , 7557-7569
Optimization of Prompt Learning via Multi-Knowledge Representation for Vision-Language Models
Vision-language models (VLMs), such as CLIP, play a foundational role in various cross-modal applications. To fully leverage the potential of VLMs in adapting to downstream tasks, context optimization methods such as prompt tuning are essential. However, one key limitation is the lack of diversity in prompt templates, whether they are hand-crafted or learned through additional modules. This limitation restricts the capabilities of pretrained VLMs and can result in incorrect predictions in downstream tasks. To address this challenge, we propose context optimization with multi-knowledge representation (CoKnow), a framework that enhances prompt learning for VLMs with rich contextual knowledge. To facilitate CoKnow during inference, we train lightweight semantic knowledge mappers, which are capable of generating multi-knowledge representations for an input image without requiring additional priors. Experimentally, we conduct extensive experiments on 11 publicly available datasets, demonstrating that CoKnow outperforms a series of previous methods.
- 14 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 27 (15209210) , 7557-7569
Optimization of Prompt Learning via Multi-Knowledge Representation for Vision-Language Models
Vision-language models (VLMs), such as CLIP, play a foundational role in various cross-modal applications. To fully leverage the potential of VLMs in adapting to downstream tasks, context optimization methods such as prompt tuning are essential. However, one key limitation is the lack of diversity in prompt templates, whether they are hand-crafted or learned through additional modules. This limitation restricts the capabilities of pretrained VLMs and can result in incorrect predictions in downstream tasks. To address this challenge, we propose context optimization with multi-knowledge representation (CoKnow), a framework that enhances prompt learning for VLMs with rich contextual knowledge. To facilitate CoKnow during inference, we train lightweight semantic knowledge mappers, which are capable of generating multi-knowledge representations for an input image without requiring additional priors. Experimentally, we conduct extensive experiments on 11 publicly available datasets, demonstrating that CoKnow outperforms a series of previous methods.