MEDIAN: Adaptive Intermediate-grained Aggregation Network for Composed Image Retrieval
Authors:
- 6 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
The Composed Image Retrieval (CIR) task aims to retrieve a target image that meets the requirements based on a given multimodal query (includes a reference image and modification text). Most existing works align multimodal semantics at both local and global granularity. However, they have failed to consider the mining of semantic correspondences at the intermediate-grained level, which has resulted in sub-optimal model performance. In this paper, we propose an adaptive interMEDiate-graIned Aggregation Network (MEDIAN). Compared with the conventional CIR models, MEDIAN is capable of generating intermediate-grained feature aggregation supervised signals and constructing graph attention networks to extract intermediate-grained features. Concurrently, MEDIAN also devises cross-modal semantic correspondence aligning guided by the target image, which in turn enables accurate multi-grained feature composition. The superiority of MEDIAN is demonstrated by extensive experiments on three benchmark datasets. Our code is available at https://windlikeo.github.io/MEDIAN.github.io/.Keywords
Funding Information
- National Natural Science Foundation of China
- Natural Science Foundation of Shandong Province
- Ministry of Education
This publication has 34 references indexed in Scilit:
- SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining2024
- FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks2023
- Effective conditioned and composed image retrieval combining CLIP-based features2022
- Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback2021
- Fractional Fourier Transform based Riesz fractional derivative approach for edge detection and its application in image enhancementSignal Processing, 2021
- Multi-grained Fusion for Conditional Image Retrieval2021
- Image Search With Text Feedback by Visiolinguistic Attention Learning2020
- Composing Text and Image for Image Retrieval - an Empirical Odyssey2019
- Deep Mutual Learning2018
- Fractional Fourier Transform and Fractional-Order Calculus-Based Image Edge DetectionCircuits, Systems, and Signal Processing, 2016