Building the Dresden Web Table Corpus: A Classification Approach
Authors:
- Julian EberiusJEJulian Eberius
- Katrin BraunschweigKBKatrin Braunschweig
- Markus HentschMHMarkus Hentsch
- Maik ThieleMTMaik Thiele
- Ahmad AhmadovAAAhmad Ahmadov
- Wolfgang LehnerWLWolfgang Lehner
- 1 December 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 41-50
Abstract
In recent years, researchers have recognized relational tables on the Web as an important source of information. To assist this research we developed the Dresden Web Tables Corpus (DWTC), a collection of about 125 million data tables extracted from the Common Crawl (CC) which contains 3.6 billion web pages and is 266TB in size. As the vast majority of HTML tables are used for layout purposes and only a small share contains genuine tables with different surface forms, accurate table detection is essential for building a large-scale Web table corpus. Furthermore, correctly recognizing the table structure (e.g. horizontal listings, matrices) is important in order to understand the role of each table cell, distinguishing between label and data cells. In this paper, we present an extensive table layout classification that enables us to identify the main layout categories of Web tables with very high precision. We therefore identify and develop a plethora of table features, different feature selection techniques and several classification algorithms. We evaluate the effectiveness of the selected features and compare the performance of various state-of-the-art classification algorithms. Finally, the winning approach is employed to classify millions of tables resulting in the Dresden Web Table Corpus (DWTC).Keywords
This publication has 15 references indexed in Scilit:
- Top-k entity augmentation using consistent set covering2015
- The WebDataCommons Microdata, RDFa and Microformat Dataset Series2014
- Web table taxonomy and formalizationACM SIGMOD Record, 2013
- Web table discrimination with composition of rich structural and content informationApplied Soft Computing, 2013
- DrillBeyondProceedings of the VLDB Endowment, 2012
- InfoGather2012
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- WebTablesProceedings of the VLDB Endowment, 2008
- Flexible Web document analysis for delivery to narrow-bandwidth devices2002
- Mining tables from large scale HTML texts2000