SEDAR: A Semantic Data Reservoir for Heterogeneous Datasets
Open Access
- 21 October 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 5056-5060
Abstract
Data lakes have emerged as a solution for managing vast and diverse datasets for modern data analytics. To prevent them from becoming ungoverned, semantic data management techniques are crucial, which involve connecting metadata with knowledge graphs, following the principles of Linked Data. This semantic layer enables more expressive data management, integration from various sources and enhances data access utilizing the concepts and relations to semantically enrich the data. Some frameworks have been proposed, but requirements like data versioning, linking of datasets, managing machine learning projects, automated semantic modeling and ontology-based data access are not supported in one uniform system. We demonstrate SEDAR, a comprehensive semantic data lake that includes support for data ingestion, storage, processing, and governance with a special focus on semantic data management. The demo will showcase how the system allows for various ingestion scenarios, metadata enrichment, data source linking, profiling, semantic modeling, data integration and processing inside a machine learning life cycle.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (13FH557KX0)
This publication has 20 references indexed in Scilit:
- Squerall: Virtual Ontology-Based Access to Heterogeneous and Large Data Sources2019
- Metadata Systems for Data Lakes: Models and Features2019
- Wie funktioniert eine Smart Paint Factory?JOT Journal für Oberflächentechnik, 2019
- Unit Testing Data with Deequ2019
- One Size Does Not Fit All: Querying Web PolystoresIEEE Access, 2019
- Modeling Relational Data with Graph Convolutional Networks2018
- On Warehouses, Lakes, and Spaces: The Changing Role of Conceptual Modeling for Data Integration2017
- Constance2016
- CLAMS2016
- Data science: Accelerating innovation and discovery in chemical engineeringAIChE Journal, 2016