Zheng Jiang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Zheng Jiang has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Mingyong Li
College of Computer and Information Science, Chongqing Normal University, Chongqing, China
2 shared publications - Honggang Zhao
Chongqing Normal University
1 shared publication - Longfei Ma
Chongqing Normal University
1 shared publication - Xiaolong Jiang
Chongqing Normal University
1 shared publication - Zongwei Zhao
College of Computer and Information Science, Chongqing Normal University, Chongqing, China
1 shared publication
Latest Publications
- Open Access
- 30 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1104-1109
CLIP-ProbCR:CLIP-based Probability embedding Combination Retrieval
Based on traditional content-based image retrieval, the novel retrieval approach of using textual information to complement query images to retrieve target images is called text-image combination retrieval, which has attracted considerable attention in recent years. However, existing combination retrieval methods based on deterministic embedding cannot accurately measure the uncertainty of data. In this paper, we propose a CLIP-based Probabilistic Combination Retrieval model (CLIP-ProbCR), which utilizes probabilistic embedding and combining methods to add probability distributions to features after CLIP encoding through Gaussian probability density function multiplication rule for feature fusion. This method can quantify the uncertainty of instance embedding, simplifies the combined retrieval model architecture without complex auxiliary information with multi-level features or large architectures, and is validated on the Fashion IQ dataset and CIRR dataset, the experimental results demonstrate the effectiveness of the proposed model.
- 30 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1104-1109
Open AccessCLIP-ProbCR:CLIP-based Probability embedding Combination Retrieval
Based on traditional content-based image retrieval, the novel retrieval approach of using textual information to complement query images to retrieve target images is called text-image combination retrieval, which has attracted considerable attention in recent years. However, existing combination retrieval methods based on deterministic embedding cannot accurately measure the uncertainty of data. In this paper, we propose a CLIP-based Probabilistic Combination Retrieval model (CLIP-ProbCR), which utilizes probabilistic embedding and combining methods to add probability distributions to features after CLIP encoding through Gaussian probability density function multiplication rule for feature fusion. This method can quantify the uncertainty of instance embedding, simplifies the combined retrieval model architecture without complex auxiliary information with multi-level features or large architectures, and is validated on the Fashion IQ dataset and CIRR dataset, the experimental results demonstrate the effectiveness of the proposed model.
- Open Access
- 6 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval
Cross-modal hashing is an important direction for multimodal data management and applications, which has recently received more and more attention. Unsupervised cross-modal retrieval does not rely on tag information and is more applicable to the real world. However it still faces some problems. Existing methods mainly encode for local features or global features. Due to the effect of negative samples, it is easy to cause noise interference. To solve these problems, we propose a Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval (MUCH) to improve these problems. Firstly, we propose a multi-view network. Images inherently contain richer semantics, and we employ a multi-view network to observe the image from different perspectives and obtain the overall and local features of the image. Secondly, we introduce a noise cancellation module to approximate the cross-modal data feature alignment from both intra-modal and cross-modal perspectives before generating the hash code. Finally, we construct a distribution-based similarity weighting matrix to replace the graphical similarity matrix. And we performed multi-view enhancement experiments on JDSH and CIRH, with 1% to 2% enhancement over DAEH on all three datasets.
- 6 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessMulti-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval
Cross-modal hashing is an important direction for multimodal data management and applications, which has recently received more and more attention. Unsupervised cross-modal retrieval does not rely on tag information and is more applicable to the real world. However it still faces some problems. Existing methods mainly encode for local features or global features. Due to the effect of negative samples, it is easy to cause noise interference. To solve these problems, we propose a Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval (MUCH) to improve these problems. Firstly, we propose a multi-view network. Images inherently contain richer semantics, and we employ a multi-view network to observe the image from different perspectives and obtain the overall and local features of the image. Secondly, we introduce a noise cancellation module to approximate the cross-modal data feature alignment from both intra-modal and cross-modal perspectives before generating the hash code. Finally, we construct a distribution-based similarity weighting matrix to replace the graphical similarity matrix. And we performed multi-view enhancement experiments on JDSH and CIRH, with 1% to 2% enhancement over DAEH on all three datasets.