Topic regression multi-modal Latent Dirichlet Allocation for image annotation
Authors:
- 1 June 2010
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3408-3415
Abstract
We present topic-regression multi-modal Latent Dirich-let Allocation (tr-mmLDA), a novel statistical topic model for the task of image and video annotation. At the heart of our new annotation model lies a novel latent variable regression approach to capture correlations between image or video features and annotation texts. Instead of sharing a set of latent topics between the 2 data modalities as in the formulation of correspondence LDA in, our approach introduces a regression module to correlate the 2 sets of topics, which captures more general forms of association and allows the number of topics in the 2 data modalities to be different. We demonstrate the power of tr-mmLDA on 2 standard annotation datasets: a 5000-image subset of COREL and a 2687-image LabelMe dataset. The proposed association model shows improved performance over correspondence LDA as measured by caption perplexity.Keywords
This publication has 7 references indexed in Scilit:
- Independent factor topic models2009
- A correlated topic model of ScienceThe Annals of Applied Statistics, 2007
- A Bayesian Hierarchical Model for Learning Natural Scene Categories2005
- Modeling scenes with local descriptors and latent aspects2005
- Formulating Semantic Image Annotation as a Supervised Learning Problem2005
- Multiple Bernoulli relevance models for image and video annotation2004
- Modeling annotated data2003