Mining Semantic Correlation of Heterogeneous Multimedia Data for Cross-Media Retrieval
Authors:
- 16 January 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 10 (2) , 221-229
Abstract
Although multimedia objects such as images, audios and texts are of different modalities, there are a great amount of semantic correlations among them. In this paper, we propose a method of transductive learning to mine the semantic correlations among media objects of different modalities so that to achieve the cross-media retrieval. Cross-media retrieval is a new kind of searching technology by which the query examples and the returned results can be of different modalities, e.g., to query images by an example of audio. First, according to the media objects features and their co-existence information, we construct a uniform cross-media correlation graph, in which media objects of different modalities are represented uniformly. To perform the cross-media retrieval, a positive score is assigned to the query example; the score spreads along the graph and media objects of target modality or MMDs with the highest scores are returned. To boost the retrieval performance, we also propose different approaches of long-term and short-term relevance feedback to mine the information contained in the positive and negative examples.Keywords
This publication has 38 references indexed in Scilit:
- Temporal event clustering for digital photo collectionsACM Transactions on Multimedia Computing, Communications, and Applications, 2005
- Retrieval of 3D objects by visual similarity2004
- Relevance feedback2004
- Scale & Affine Invariant Interest Point DetectorsInternational Journal of Computer Vision, 2004
- Boosting Image RetrievalInternational Journal of Computer Vision, 2004
- Evaluation of salient point techniquesImage and Vision Computing, 2003
- Semantic visual templates: linking visual features to semantics2002
- On the efficient evaluation of relaxed queries in biological databases2002
- Semantic Video Retrieval Using Audio AnalysisLecture Notes in Computer Science, 2002
- Evaluation of Interest Point DetectorsInternational Journal of Computer Vision, 2000