Latent Dirichlet Allocation and POS Tags Based Method for External Plagiarism Detection
- 1 July 2018
- journal article
- research article
- Published by IGI Global Scientific Publishing in International Journal on Semantic Web and Information Systems
- Vol. 14 (3) , 53-69
Abstract
In this article we present a new semantic and syntactic-based method for external plagiarism detection. In the proposed approach, latent dirichlet allocation (LDA) and parts of speech (POS) tags are used together to detect plagiarism between the sample and a number of source documents. The basic hypothesis is that considering semantic and syntactic information between two text documents may improve the performance of the plagiarism detection task. Our method is based on two steps, naming, which is a pre-processing where we detect the topics from the sentences in documents using the LDA and convert each sentence in POS tags array; then a post processing step where the suspicious cases are verified purely on the basis of semantic rules. For two types of external plagiarism (copy and random obfuscation), we empirically compare our approach to the state-of-the-art N-gram based and stop-word N-gram based methods and observe significant improvements.Keywords
This publication has 12 references indexed in Scilit:
- A systematic study of knowledge graph analysis for cross-language plagiarism detectionInformation Processing & Management, 2016
- Topic-based heterogeneous rankScientometrics, 2015
- Plagiarism detection on electronic text based assignments using vector space model2015
- Identification of Plagiarism Using Syntactic and Semantic Filters2014
- Latent Dirichlet Allocation Based Semantic Clustering of Heterogeneous Deep Web Sources2013
- Plagiarism detection using stopword n-gramsJournal of the American Society for Information Science and Technology, 2011
- A Knowledge-Based Semantic Kernel for Text Classification2011
- Knowledge discovery through directed probabilistic topic models: a surveyFrontiers of Computer Science in China, 2010
- The English Noun Phrase2007
- Cheating in Academic Institutions: A Decade of ResearchEthics & Behavior, 2001