Dissemin is shutting down on January 1st, 2025

Published in

Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007)

DOI: 10.1109/e-science.2007.22

Links

Tools

Export citation

Search in Google Scholar

Connecting Scientific Data to Scientific Experiments with Provenance

Proceedings article published in 2007 by Simon Miles ORCID, Ewa Deelman, Paul Groth ORCID, Karan Vahi, Gaurang Mehta, Luc Moreau
This paper is available in a repository.
This paper is available in a repository.

Full text: Download

Green circle
Preprint: archiving allowed
Green circle
Postprint: archiving allowed
Red circle
Published version: archiving forbidden
Data provided by SHERPA/RoMEO

Abstract

As scientific workflows and the data they operate on, grow in size and complexity, the task of defining how those workflows should execute (which resources to use, where the resources must be in readiness for processing etc.) becomes proportionally more difficult. While "workflow compilers", such as Pegasus, reduce this burden, a further problem arises: since specifying details of execution is now automatic, a workflow's results are harder to interpret, as they are partly due to specifics of execution. By automating steps between the experiment design and its results, we lose the connection between them, hindering interpretation of results. To reconnect the scientific data with the original experiment, we argue that scientists should have access to the full provenance of their data, including not only parameters, inputs and intermediary data, but also the abstract experiment, refined into a concrete execution by the "workflow compiler". In this paper, we describe preliminary work on adapting Pegasus to capture the process of workflow refinement in the PASOA provenance system.