Probabilistic Latent Document Network Embedding
Authors:
- Tuan M.V. LeTLTuan M.V. Le
- Hady W. LauwHLHady W. Lauw
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15504786,p. 270-279
Abstract
A document network refers to a data type that can be represented as a graph of vertices, where each vertex is associated with a text document. Examples of such a data type include hyperlinked Web pages, academic publications with citations, and user profiles in social networks. Such data have very high-dimensional representations, in terms of text as well as network connectivity. In this paper, we study the problem of embedding, or finding a low-dimensional representation of a document network that "preserves" the data as much as possible. These embedded representations are useful for various applications driven by dimensionality reduction, such as visualization or feature selection. While previous works in embedding have mostly focused on either the textual aspect or the network aspect, we advocate a holistic approach by finding a unified low-rank representation for both aspects. Moreover, to lend semantic interpretability to the low-rank representation, we further propose to integrate topic modeling and embedding within a joint model. The gist is to join the various representations of a document (words, links, topics, and coordinates) within a generative model, and to estimate the hidden representations through MAP estimation. We validate our model on real-life document networks, showing that it outperforms comparable baselines comprehensively on objective evaluation metrics.Keywords
This publication has 26 references indexed in Scilit:
- TopicNetsACM Transactions on Intelligent Systems and Technology, 2012
- Mean Reciprocal Rank2009
- Parametric Embedding for Class VisualizationNeural Computation, 2007
- Principal Component Analysis2005
- Metrics for Graph Drawing AestheticsJournal of Visual Languages & Computing, 2002
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Graph drawing by force‐directed placementSoftware: Practice and Experience, 1991
- On the limited memory BFGS method for large scale optimizationMathematical Programming, 1989
- An algorithm for drawing general undirected graphsInformation Processing Letters, 1989