Keyword Extraction from Arabic Documents using Term Equivalence Classes
Author:
Open Access
- 20 April 2015
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 14 (2) , 1-18
Abstract
The rapid growth of the Internet and other computing facilities in recent years has resulted in the creation of a large amount of text in electronic form, which has increased the interest in and importance of different automatic text processing applications, including keyword extraction and term indexing. Although keywords are very useful for many applications, most documents available online are not provided with keywords. We describe a method for extracting keywords from Arabic documents. This method identifies the keywords by combining linguistics and statistical analysis of the text without using prior knowledge from its domain or information from any related corpus. The text is preprocessed to extract the main linguistic information, such as the roots and morphological patterns of derivative words. A cleaning phase is then applied to eliminate the meaningless words from the text. The most frequent terms are clustered into equivalence classes in which the derivative words generated from the same root and the non-derivative words generated from the same stem are placed together, and their count is accumulated. A vector space model is then used to capture the most frequent N-gram in the text. Experiments carried out using a real-world dataset show that the proposed method achieves good results with an average precision of 31% and average recall of 53% when tested against manually assigned keywords.Keywords
This publication has 13 references indexed in Scilit:
- Automatic Keyword Extraction from Individual Documents2010
- KP-Miner: A keyphrase extraction system for English and Arabic documentsInformation Systems, 2009
- Automatic Processing of Modern Standard Arabic Text2007
- On Arabic Transliteration2007
- KEYWORD EXTRACTION FROM A SINGLE DOCUMENT USING WORD CO-OCCURRENCE STATISTICAL INFORMATIONInternational Journal on Artificial Intelligence Tools, 2004
- Arabic morphological analysis techniques: A comprehensive surveyJournal of the American Society for Information Science and Technology, 2003
- Improved automatic keyword extraction given more linguistic knowledge2003
- KEA1999
- A vector space model for automatic indexingCommunications of the ACM, 1975
- A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVALJournal of Documentation, 1972