Detecting and modeling local text reuse
Authors:
- 1 September 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 183-192
Abstract
Texts propagate through many social networks and provide evidence for their structure. We describe and evaluate efficient algorithms for detecting clusters of reused passages embedded within longer documents in large collections. We apply these techniques to two case studies: analyzing the culture of free reprinting in the nineteenth-century United States and the development of bills into legislation in the U.S. Congress. Using these divergent case studies, we evaluate both the efficiency of the approximate local text reuse detection methods and the accuracy of the results. These techniques allow us to explore how ideas spread, which ideas spread, and which subgroups shared ideas.Keywords
This publication has 15 references indexed in Scilit:
- Homomorphic fingerprints under misalignments2013
- NIFTY2013
- Congress and the Politics of Problem Solving2013
- Finding and exploring memes in social media2012
- Partial duplicate detection for large book collections2011
- Meme-tracking and the dynamics of the news cycle2009
- Finding near-duplicate web pages2006
- A Scalable System for Identifying Co-derivative DocumentsLecture Notes in Computer Science, 2004
- Algorithms on Strings, Trees and Sequences1997
- Efficiency of a Good But Not Linear Set Union AlgorithmJournal of the ACM, 1975