Keyphrase Extraction Using Enhanced Word and Document Embedding
- 7 August 2022
- journal article
- research article
- Published by Taylor & Francis in IETE Journal of Research
- Vol. 69 (12) , 8876-8888
Abstract
We live in a world where information is available, in all areas of human activity, increasingly in digital text documents. It is necessary to explore the knowledge implied in these documents considering its fast-growing availability. The use of keywords provides for a more effective search for a document of interest, as keywords highlight a document's primary concept and, therefore, allow the researcher's interest to be readily aligned with that text. In this article, an unsupervised keyword extraction approach is proposed. The proposed approach retrofitted the concept of n-grams with state-of-the-art words and document embeddings. The approach simultaneously proposed a new method to compose document vectors using important word vectors and their idf-scores. Here we use higher-order word n-grams to improve various unigram embeddings and introduce a novel task to produce document embedding for document representation. The performance of the proposed embeddings is evaluated using four different datasets. The combination of higher-order word n-grams retrofitted Glove, and document embedding is the best embedding to be used for extracting key phrases. The bi-gram retrofitted embedding improves the results significantly over the baseline approaches.Keywords
Funding Information
- Deanship of Scientific Research
- King Abdulaziz University (G-16-611-1441)
This publication has 36 references indexed in Scilit:
- Glove: Global Vectors for Word Representation2014
- Automatic Keyword Extraction from Individual Documents2010
- Domain‐independent automatic keyphrase indexing with small training setsJournal of the American Society for Information Science and Technology, 2008
- Unsupervised Multilingual Sentence Boundary DetectionComputational Linguistics, 2006
- Authoritative sources in a hyperlinked environmentJournal of the ACM, 1999
- The anatomy of a large-scale hypertextual Web search engineComputer Networks and ISDN Systems, 1998
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- Efficient algorithms for agglomerative hierarchical clustering methodsJournal of Classification, 1984
- A vector space model for automatic indexingCommunications of the ACM, 1975
- The most predictable criterion.Journal of Educational Psychology, 1935