Harvesting Entities from the Web Using Unique Identifiers -- IBEX
Authors:
- Aliaksandr TalaikaATAliaksandr Talaika
- Joanna BiegaJBJoanna Biega
- Antoine AmarilliAAAntoine Amarilli
- Fabian M. SuchanekFSFabian M. Suchanek
Preprint
Abstract
In this paper we study the prevalence of unique entity identifiers on the Web. These are, e.g., ISBNs (for books), GTINs (for commercial products), DOIs (for documents), email addresses, and others. We show how these identifiers can be harvested systematically from Web pages, and how they can be associated with human-readable names for the entities at large scale. Starting with a simple extraction of identifiers and names from Web pages, we show how we can use the properties of unique identifiers to filter out noise and clean up the extraction result on the entire corpus. The end result is a database of millions of uniquely identified entities of different types, with an accuracy of 73--96% and a very high coverage compared to existing knowledge bases. We use this database to compute novel statistics on the presence of products, people, and other entities on the Web.Keywords
All Related Versions
- Version 1, 2015-05-05, ArXiv
- Published version: , 13.
This publication has 27 references indexed in Scilit:
- Automatic Extraction of Structured Web Data with Domain Knowledge2012
- Quantitative Analysis of Culture Using Millions of Digitized BooksScience, 2011
- ViDE: A Vision-Based Approach for Deep Web Data ExtractionIEEE Transactions on Knowledge and Data Engineering, 2009
- DBpedia: A Nucleus for a Web of Open Data2007
- A Survey of Web Information Extraction SystemsIEEE Transactions on Knowledge and Data Engineering, 2006
- Simultaneous record detection and attribute labeling in web data extraction2006
- Text mining for product attribute extractionACM SIGKDD Explorations Newsletter, 2006
- Web data extraction based on partial tree alignment2005
- Fully automatic wrapper generation for search engines2005
- Extracting Content Structure for Web Pages Based on Visual Representation2003