Demonstrating MATE and COCOA for Data Discovery
Open Access
- 4 June 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 119-122
Abstract
One of the common use cases for data discovery is to enrich a given table with additional columns from related tables inside a data lake. We have recently introduced MATE and COCOA, two systems for joinability discovery and correlation calculation, respectively. By leveraging two novel index structures, a hash-based Super Key Index, and an Order Index, our system is capable of efficiently identifying tables that join on multiple columns and contain relevant features. We show how the data exploration and enrichment process benefits from our index structures by demonstrating MaCo, a unified system on top of open web and large table corpora.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (387872445)
This publication has 10 references indexed in Scilit:
- A Sketch-based Index for Correlated Dataset Search2022
- MATEProceedings of the VLDB Endowment, 2022
- Valentine in actionProceedings of the VLDB Endowment, 2021
- Correlation Sketches for Approximate Join-Correlation Queries2021
- Delta lakeProceedings of the VLDB Endowment, 2020
- JOSIE2019
- A Demo of the Data Civilizer System2017
- LSH ensembleProceedings of the VLDB Endowment, 2016
- To Join or Not to Join?2016
- DataXFormer: A robust transformation discovery system2016