Text-to-Text Similarity of Sentences
Authors:
- 1 January 2012
- book chapter
- Published by IGI Global Scientific Publishing
- p. 110-121
Abstract
Assessing the semantic similarity between two texts is a central task in many applications, including summarization, intelligent tutoring systems, and software testing. Similarity of texts is typically explored at the level of word, sentence, paragraph, and document. The similarity can be defined quantitatively (e.g. in the form of a normalized value between 0 and 1) and qualitatively in the form of semantic relations such as elaboration, entailment, or paraphrase. In this chapter, we focus first on measuring quantitatively and then on detecting qualitatively sentence-level text-to-text semantic relations. A generic approach that relies on word-to-word similarity measures is presented as well as experiments and results obtained with various instantiations of the approach. In addition, we provide results of a study on the role of weighting in Latent Semantic Analysis, a statistical technique to assess similarity of texts. The results were obtained on two data sets: a standard data set on sentence-level paraphrase detection and a data set from an intelligent tutoring system.Keywords
This publication has 4 references indexed in Scilit:
- Handbook of Latent Semantic Analysis2007
- Measuring the semantic similarity of texts2005
- iSTART: Interactive strategy training for active reading and thinkingBehavior Research Methods, Instruments, & Computers, 2004
- Unsupervised construction of large paraphrase corpora2004