Latent Topic Model for Indexing Arabic Documents
- 1 April 2014
- journal article
- Published by IGI Global Scientific Publishing in International Journal of Information Retrieval Research
- Vol. 4 (2) , 57-72
Abstract
In this paper, the authors present latent topic model to index and represent the Arabic text documents reflecting more semantics. Text representation in a language with high inflectional morphology such as Arabic is not a trivial task and requires some special treatments. The authors describe their approach for analyzing and preprocessing Arabic text then they describe the stemming process. Finally, the latent model (LDA) is adapted to extract Arabic latent topics, the authors extracted significant topics of all texts, each theme is described by a particular distribution of descriptors then each text is represented on the vectors of these topics. The experiment of classification is conducted on in house corpus; latent topics are learned with LDA for different topic numbers K (25, 50, 75, and 100) then they compare this result with classification in the full words space. The results show that performances, in terms of precision, recall and f-measure, of classification in the reduced topics space outperform classification in full words space and when using LSI reduction.Keywords
This publication has 15 references indexed in Scilit:
- SCAT: a system of classification for Arabic textsInternational Journal of Internet Technology and Secured Transactions, 2011
- Feature reduction techniques for Arabic text categorizationJournal of the American Society for Information Science and Technology, 2009
- Pachinko allocation2006
- Finding scientific topicsProceedings of the National Academy of Sciences of the United States of America, 2004
- On arabic search2002
- Improving stemming for Arabic information retrieval2002
- Text categorization with Support Vector Machines: Learning with many relevant features1998
- A computational morphology system for Arabic1998
- Large-Scale Sparse Singular Value ComputationsThe International Journal of Supercomputing Applications, 1992
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990