Lineage retrieval for scientific data processing: a survey
Authors:
Top Cited Papers
Open Access
- 1 March 2005
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 37 (1) , 1-28
Abstract
Scientific research relies as much on the dissemination and exchange of data sets as on the publication of conclusions. Accurately tracking the lineage (origin and subsequent processing history) of scientific data sets is thus imperative for the complete documentation of scientific work. Researchers are effectively prevented from determining, preserving, or providing the lineage of the computational data products they use and create, however, because of the lack of a definitive model for lineage retrieval and a poor fit between current data management tools and scientific software. Based on a comprehensive survey of lineage research and previous prototypes, we present a metamodel to help identify and assess the basic components of systems that provide lineage retrieval for scientific data products.Keywords
This publication has 29 references indexed in Scilit:
- Lineage tracing for general data warehouse transformationsThe VLDB Journal, 2003
- Tracing the lineage of view data in a warehousing environmentACM Transactions on Database Systems, 2000
- Version models for software configuration managementACM Computing Surveys, 1998
- PIF The Process Interchange Format1998
- Data management for earth system scienceACM SIGMOD Record, 1997
- An overview of the Object Protocol Model (OPM) and the OPM data management toolsInformation Systems, 1995
- Computational modeling systemsInformation Systems, 1995
- An overview of workflow management: From process modeling to workflow automation infrastructureDistributed and Parallel Databases, 1995
- Enhancing Value of Environmental Data: Data Lineage ReportingJournal of Environmental Engineering, 1993
- Auditing of Data AnalysesSIAM Journal on Scientific and Statistical Computing, 1988