The Hidden Markov Topic Model: A Probabilistic Model of Semantic Representation
- 13 January 2010
- journal article
- Published by Wiley in Topics in Cognitive Science
- Vol. 2 (1) , 101-113
Abstract
In this paper, we describe a model that learns semantic representations from the distributional statistics of language. This model, however, goes beyond the common bag‐of‐words paradigm, and infers semantic representations by taking into account the inherent sequential nature of linguistic data. The model we describe, which we refer to as a Hidden Markov Topics model, is a natural extension of the current state of the art in Bayesian bag‐of‐words models, that is, the Topics model of Griffiths, Steyvers, and Tenenbaum (2007), preserving its strengths while extending its scope to incorporate more fine‐grained linguistic information.Keywords
This publication has 14 references indexed in Scilit:
- Integrating experiential and distributional data to learn semantic representations.Psychological Review, 2009
- A Computational Model of Early Argument Structure AcquisitionCognitive Science, 2008
- Dependency-Based Construction of Semantic Space ModelsComputational Linguistics, 2007
- Topics in semantic representation.Psychological Review, 2007
- Representing word meaning and order information in a composite holographic lexicon.Psychological Review, 2007
- Topic modeling2006
- 10.1162/jmlr.2003.3.4-5.993Applied Physics Letters, 2000
- A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge.Psychological Review, 1997
- Adaptive Rejection Sampling for Gibbs SamplingJournal of the Royal Statistical Society Series C: Applied Statistics, 1992
- Distributional Structure1970