FlashExtract
Authors:
Open Access
- 5 June 2014
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGPLAN Notices
- Vol. 49 (6) , 542-553
Abstract
Various document types that combine model and view (e.g., text files, webpages, spreadsheets) make it easy to organize (possibly hierarchical) data, but make it difficult to extract raw data for any further manipulation or querying. We present a general framework FlashExtract to extract relevant data from semi-structured documents using examples. It includes: (a) an interaction model that allows end-users to give examples to extract various fields and to relate them in a hierarchical organization using structure and sequence constructs. (b) an inductive synthesis algorithm to synthesize the intended program from few examples in any underlying domain-specific language for data extraction that has been built using our specified algebra of few core operators (map, filter, merge, and pair). We describe instantiation of our framework to three different domains: text files, webpages, and spreadsheets. On our benchmark comprising 75 documents, FlashExtract is able to extract intended data using an average of 2.36 examples in 0.84 seconds per field.Keywords
This publication has 18 references indexed in Scilit:
- Synthesis from Examples: Interaction Models and Algorithms2012
- Spreadsheet data manipulation using examplesCommunications of the ACM, 2012
- Spreadsheet table transformations from examples2011
- The PADS project2011
- Automating string processing in spreadsheets using input-output examples2011
- From spreadsheets to relational databases and back2009
- From dirt to shovels2008
- Header and Unit Inference for Spreadsheets Through Spatial Analyses2005
- IEPAD2001
- Generating finite-state transducers for semi-structured data extraction from the WebInformation Systems, 1998