Longfei Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Longfei Ma has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Mingyong Li
College of Computer and Information Science, Chongqing Normal University, Chongqing, China
6 shared publications - Mingyuan Ge
School of Big Data and Software Engineering, Chongqing University, Chongqing, China
4 shared publications - Yewen Li
College of Computer Science and Technology, National University of Defense Technology, Changsha, China
4 shared publications - Honggang Zhao
Chongqing Normal University
2 shared publications - Honggang Zhao
College of Computer and Information Science, Chongqing Normal University, Chongqing, China
1 shared publication Mingyong Li
Chongqing Normal University
1 shared publication
Latest Publications
- Open Access
- 6 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval
Cross-modal hashing is an important direction for multimodal data management and applications, which has recently received more and more attention. Unsupervised cross-modal retrieval does not rely on tag information and is more applicable to the real world. However it still faces some problems. Existing methods mainly encode for local features or global features. Due to the effect of negative samples, it is easy to cause noise interference. To solve these problems, we propose a Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval (MUCH) to improve these problems. Firstly, we propose a multi-view network. Images inherently contain richer semantics, and we employ a multi-view network to observe the image from different perspectives and obtain the overall and local features of the image. Secondly, we introduce a noise cancellation module to approximate the cross-modal data feature alignment from both intra-modal and cross-modal perspectives before generating the hash code. Finally, we construct a distribution-based similarity weighting matrix to replace the graphical similarity matrix. And we performed multi-view enhancement experiments on JDSH and CIRH, with 1% to 2% enhancement over DAEH on all three datasets.
- 6 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessMulti-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval
Cross-modal hashing is an important direction for multimodal data management and applications, which has recently received more and more attention. Unsupervised cross-modal retrieval does not rely on tag information and is more applicable to the real world. However it still faces some problems. Existing methods mainly encode for local features or global features. Due to the effect of negative samples, it is easy to cause noise interference. To solve these problems, we propose a Multi-view–enhanced modal fusion hashing for Unsupervised cross-modal retrieval (MUCH) to improve these problems. Firstly, we propose a multi-view network. Images inherently contain richer semantics, and we employ a multi-view network to observe the image from different perspectives and obtain the overall and local features of the image. Secondly, we introduce a noise cancellation module to approximate the cross-modal data feature alignment from both intra-modal and cross-modal perspectives before generating the hash code. Finally, we construct a distribution-based similarity weighting matrix to replace the graphical similarity matrix. And we performed multi-view enhancement experiments on JDSH and CIRH, with 1% to 2% enhancement over DAEH on all three datasets.
- 9 August 2023
- Published by Springer Nature
- p. 163-174
Modal Interaction-Enhanced Prompt Learning by Transformer Decoder for Vision-Language Models
- 9 August 2023
- Published by Springer Nature
- p. 163-174
Modal Interaction-Enhanced Prompt Learning by Transformer Decoder for Vision-Language Models
- 3 August 2023
- Published by Springer Nature in International Journal of Multimedia Information Retrieval
- Vol. 12 (2) , 1-10
Modal interaction-enhanced prompt learning by transformer decoder for vision-language models
- 3 August 2023
- Published by Springer Nature in International Journal of Multimedia Information Retrieval
- Vol. 12 (2) , 1-10
Modal interaction-enhanced prompt learning by transformer decoder for vision-language models
- Open Access
- 12 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 612-616
Deep Enhanced-Similarity Attention Cross-modal Hashing Learning
Despite the great success of existing cross-modal retrieval methods, existing unsupervised cross-modal hashing methods still suffer from common problems. First, the features extracted from the text are too sparse. Second, the similarity matrices of each different modality cannot be fused adaptively. In this paper, we propose Deep Enhanced-Similarity Attention Hashing (DESAH) to alleviate the above problems. Firstly, we construct a text encoder expanding graph convolutional neural network to simultaneously extract features of samples and their semantic neighbors to enrich text features. Secondly, we propose an enhanced attention fusion mechanism. The mechanism is used to adaptively fuse the similarity matrices within different modalities to form a unified inter-modal similarity matrix to guide the learning of hash functions. Extensive experiments have demonstrated that DESAH provides significant improvements in cross-modal retrieval tasks compared to baseline methods.
- 12 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 612-616
Open AccessDeep Enhanced-Similarity Attention Cross-modal Hashing Learning
Despite the great success of existing cross-modal retrieval methods, existing unsupervised cross-modal hashing methods still suffer from common problems. First, the features extracted from the text are too sparse. Second, the similarity matrices of each different modality cannot be fused adaptively. In this paper, we propose Deep Enhanced-Similarity Attention Hashing (DESAH) to alleviate the above problems. Firstly, we construct a text encoder expanding graph convolutional neural network to simultaneously extract features of samples and their semantic neighbors to enrich text features. Secondly, we propose an enhanced attention fusion mechanism. The mechanism is used to adaptively fuse the similarity matrices within different modalities to form a unified inter-modal similarity matrix to guide the learning of hash functions. Extensive experiments have demonstrated that DESAH provides significant improvements in cross-modal retrieval tasks compared to baseline methods.
- 22 February 2023
- Published by Springer Nature in International Journal of Multimedia Information Retrieval
- Vol. 12 (1) , 1-17
CLIP-based fusion-modal reconstructing hashing for large-scale unsupervised cross-modal retrieval
- 22 February 2023
- Published by Springer Nature in International Journal of Multimedia Information Retrieval
- Vol. 12 (1) , 1-17
CLIP-based fusion-modal reconstructing hashing for large-scale unsupervised cross-modal retrieval
- Open Access
- 1 January 2023
- Published by Wiley in International Journal of Intelligent Systems
- Vol. 2023 (1)
CCAH: A CLIP‐Based Cycle Alignment Hashing Method for Unsupervised Vision‐Text Retrieval
Due to the advantages of low storage cost and fast retrieval efficiency, deep hashing methods are widely used in cross‐modal retrieval. Images are usually accompanied by corresponding text descriptions rather than labels. Therefore, unsupervised methods have been widely concerned. However, due to the modal divide and semantic differences, existing unsupervised methods cannot adequately bridge the modal differences, leading to suboptimal retrieval results. In this paper, we propose CLIP‐based cycle alignment hashing for unsupervised vision‐text retrieval (CCAH), which aims to exploit the semantic link between the original features of modalities and the reconstructed features. Firstly, we design a modal cyclic interaction method that aligns semantically within intramodality, where one modal feature reconstructs another modal feature, thus taking full account of the semantic similarity between intramodal and intermodal relationships. Secondly, introducing GAT into cross‐modal retrieval tasks. We consider the influence of text neighbour nodes and add attention mechanisms to capture the global features of text modalities. Thirdly, Fine‐grained extraction of image features using the CLIP visual coder. Finally, hash encoding is learned through hash functions. The experiments demonstrate on three widely used datasets that our proposed CCAH achieves satisfactory results in total retrieval accuracy. Our code can be found at: https://github.com/CQYIO/CCAH.git.
- 1 January 2023
- Published by Wiley in International Journal of Intelligent Systems
- Vol. 2023 (1)
Open AccessCCAH: A CLIP‐Based Cycle Alignment Hashing Method for Unsupervised Vision‐Text Retrieval
Due to the advantages of low storage cost and fast retrieval efficiency, deep hashing methods are widely used in cross‐modal retrieval. Images are usually accompanied by corresponding text descriptions rather than labels. Therefore, unsupervised methods have been widely concerned. However, due to the modal divide and semantic differences, existing unsupervised methods cannot adequately bridge the modal differences, leading to suboptimal retrieval results. In this paper, we propose CLIP‐based cycle alignment hashing for unsupervised vision‐text retrieval (CCAH), which aims to exploit the semantic link between the original features of modalities and the reconstructed features. Firstly, we design a modal cyclic interaction method that aligns semantically within intramodality, where one modal feature reconstructs another modal feature, thus taking full account of the semantic similarity between intramodal and intermodal relationships. Secondly, introducing GAT into cross‐modal retrieval tasks. We consider the influence of text neighbour nodes and add attention mechanisms to capture the global features of text modalities. Thirdly, Fine‐grained extraction of image features using the CLIP visual coder. Finally, hash encoding is learned through hash functions. The experiments demonstrate on three widely used datasets that our proposed CCAH achieves satisfactory results in total retrieval accuracy. Our code can be found at: https://github.com/CQYIO/CCAH.git.
- Open Access
- 19 December 2022
- Published by Springer Nature in Research Square
CCAH: a CLIP-based Cycle Alignment Hashing method for unsupervised vision-text retrieval
Due to the advantages of low storage cost and fast retrieval efficiency, deep hashing methods are widely used in cross-modal retrieval. Images are usually accompanied by corresponding text descriptions rather than labels. Therefore, unsupervised methods have been widely concerned. However, due to the modal divide and semantic differences, existing unsupervised methods cannot adequately bridge the modal differences, leading to suboptimal retrieval results. In this paper, we propose CLIPbased Cycle Alignment Hashing for unsupervised vision-text retrieval (CCAH), which aims to exploit the semantic link between the original features of modalities and the reconstructed features. Firstly we design a modal cyclic interaction method that aligns semantically within intramodality, where one modal feature reconstructs another modal feature, thus taking full account of the semantic similarity between intra-modal and inter-modal relationships. Secondly, introducing GAT into crossmodal retrieval tasks. Consider the influence of text neighbour nodes and add attention mechanisms to capture the global features of text modalities. Thirdly, Fine-grained extraction of image features using the CLIP visual coder. Finally, hash encoding is learning through hash functions. The experiments demonstrate on three widely used datasets that our proposed CCAH achieves satisfactory results in total retrieval accuracy. Our code can be found at :https://github.com/CQYIO/CCAH.git.
- 19 December 2022
- Published by Springer Nature in Research Square
Open AccessCCAH: a CLIP-based Cycle Alignment Hashing method for unsupervised vision-text retrieval
Due to the advantages of low storage cost and fast retrieval efficiency, deep hashing methods are widely used in cross-modal retrieval. Images are usually accompanied by corresponding text descriptions rather than labels. Therefore, unsupervised methods have been widely concerned. However, due to the modal divide and semantic differences, existing unsupervised methods cannot adequately bridge the modal differences, leading to suboptimal retrieval results. In this paper, we propose CLIPbased Cycle Alignment Hashing for unsupervised vision-text retrieval (CCAH), which aims to exploit the semantic link between the original features of modalities and the reconstructed features. Firstly we design a modal cyclic interaction method that aligns semantically within intramodality, where one modal feature reconstructs another modal feature, thus taking full account of the semantic similarity between intra-modal and inter-modal relationships. Secondly, introducing GAT into crossmodal retrieval tasks. Consider the influence of text neighbour nodes and add attention mechanisms to capture the global features of text modalities. Thirdly, Fine-grained extraction of image features using the CLIP visual coder. Finally, hash encoding is learning through hash functions. The experiments demonstrate on three widely used datasets that our proposed CCAH achieves satisfactory results in total retrieval accuracy. Our code can be found at :https://github.com/CQYIO/CCAH.git.