Unsupervised Methods for Determining Object and Relation Synonyms on the Web
Preprint
Abstract
The task of identifying synonymous relations and objects, or synonym resolution, is critical for high-quality information extraction. This paper investigates synonym resolution in the context of unsupervised information extraction, where neither hand-tagged training examples nor domain knowledge is available. The paper presents a scalable, fully-implemented system that runs in O(KN log N) time in the number of extractions, N, and the maximum number of synonyms per word, K. The system, called Resolver, introduces a probabilistic relational model for predicting whether two strings are co-referential based on the similarity of the assertions containing them. On a set of two million assertions extracted from the Web, Resolver resolves objects with 78% precision and 68% recall, and resolves relations with 90% precision and 35% recall. Several variations of resolvers probabilistic model are explored, and experiments demonstrate that under appropriate conditions these variations can improve F1 by 5%. An extension to the basic Resolver system allows it to handle polysemous names with 97% precision and 95% recall on a data set from the TREC corpus.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Open information extraction from the webCommunications of the ACM, 2008
- Name Discrimination and E-mail Clustering Using Unsupervised Clustering of Similar ContextsJournal of Intelligent Systems, 2008
- Query-time Entity ResolutionJournal of Artificial Intelligence Research, 2007
- Sparse Information Extraction: Unsupervised Language Models to the Rescue2007
- Entity Resolution with Markov LogicIEEE International Conference on Data Mining (ICDM), 2006
- A Probabilistic Model of Redundancy in Information Extraction2006
- Reference reconciliation in complex information spaces2005
- Unsupervised named-entity extraction from the Web: An experimental studyArtificial Intelligence, 2005
- Efficient clustering of high-dimensional data sets with application to reference matching2000
- Selected Studies of the Principle of Relative Frequency in Language. By George Kingsley Zipf. Harvard University Press, 1932.Language, 1933