Representing Documents via Latent Keyphrase Inference
Open Access
- 11 April 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 2016, 1057-1067
Abstract
Many text mining approaches adopt bag-of-words or $n$-grams models to represent documents. Looking beyond just the words, fiie, the explicit surface forms, in a document can improve a computer's understanding of text. Being aware of this, researchers have proposed concept-based models that rely on a human-curated knowledge base to incorporate other related concepts in the document representation. But these methods are not desirable when applied to vertical domains (eg, literature, enterprise, etc) due to low coverage of in-domain concepts in the general knowledge base and interference from out-of-domain concepts. In this paper, we propose a data-driven model named Latent Keyphrase Inference LAKI) that represents documents with a vector of closely related domain keyphrases instead of single words or existing concepts in the knowledge base. We show that given a corpus of in-domain documents, topical content units can be learned for each domain keyphrase, which enables a computer to do smart inference to discover latent document keyphrases, going beyond just explicit mentions. Compared with the state-of-art document representation approaches, LAKI fills the gap between bag-of-words and concept-based models by using domain keyphrases as the basic representation unit. It removes dependency on a knowledge base while providing, with keyphrases, readily interpretable representations. When evaluated against 8 other methods on two text mining tasks over two corpora, LAKI outperformed all.Keywords
Funding Information
- National Science Foundation (IIS-1017362 IIS- 1320617 and IIS-1354329 HDTRA1-10-1-0120)
- U.S. Army Research Lab. (W911NF-09-2-0053)
- trans-NIH Big Data to Knowledge (BD2K) (1U54GM114838)
This publication has 17 references indexed in Scilit:
- Mining Quality Phrases from Massive Text Corpora2015
- Scalable topical phrase mining from text corporaProceedings of the VLDB Endowment, 2014
- Probase2012
- Scalable influence maximization for independent cascade model in large-scale social networksData Mining and Knowledge Discovery, 2012
- Insights into explicit semantic analysis2011
- DBpedia - A crystallization point for the Web of DataJournal of Web Semantics, 2009
- TextOntoEx: Automatic ontology construction from natural English textExpert Systems with Applications, 2008
- Improved automatic keyword extraction given more linguistic knowledge2003
- KEA1999
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990