Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval
Open Access
- 6 December 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Abstract
Cross-modal hashing is an important direction for multimodal data management and applications, which has recently received more and more attention. Unsupervised cross-modal retrieval does not rely on tag information and is more applicable to the real world. However it still faces some problems. Existing methods mainly encode for local features or global features. Due to the effect of negative samples, it is easy to cause noise interference. To solve these problems, we propose a Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval (MUCH) to improve these problems. Firstly, we propose a multi-view network. Images inherently contain richer semantics, and we employ a multi-view network to observe the image from different perspectives and obtain the overall and local features of the image. Secondly, we introduce a noise cancellation module to approximate the cross-modal data feature alignment from both intra-modal and cross-modal perspectives before generating the hash code. Finally, we construct a distribution-based similarity weighting matrix to replace the graphical similarity matrix. And we performed multi-view enhancement experiments on JDSH and CIRH, with 1% to 2% enhancement over DAEH on all three datasets.Keywords
Funding Information
- the Science and Technology Research Program of Chongqing Municipal Education Commission (KJZD-K202200513)
- Chongqing Natural Science Foundation (CSTB2022NSCQ-MSX1417)
- Humanities and Social Science research project of Chongqing Education Commission (22SKGH100)
This publication has 18 references indexed in Scilit:
- Deep Semantic-Alignment Hashing for Unsupervised Cross-Modal Retrieval2020
- Deep Joint-Semantics Reconstructing Hashing for Large-Scale Unsupervised Cross-Modal Retrieval2019
- Equally-Guided Discriminative Hashing for Cross-modal Retrieval2019
- Discrete Latent Factor Model for Cross-Modal HashingIEEE Transactions on Image Processing, 2019
- Multi-Scale Correlation for Sequential Cross-modal Hashing Learning2018
- Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrieval2018
- Triplet-Based Deep Hashing Network for Cross-Modal RetrievalIEEE Transactions on Image Processing, 2018
- Microsoft COCO: Common Objects in Context2014
- NUS-WIDE2009
- The MIR flickr retrieval evaluation2008