Back to Search Start Over

State-Space Optimization of ETL Workflows.

Authors :
Simitsis, Alkis
Vassiliadis, Panos
Sellis, Timos
Source :
IEEE Transactions on Knowledge & Data Engineering. Oct2005, Vol. 17 Issue 10, p1404-1419. 16p.
Publication Year :
2005

Abstract

Extraction-Transformation-Loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization, and insertion into a data warehouse. In this paper, we delve into the logical optimization of ETL processes, modeling it as a state-space search problem. We consider each ETL workflow as a state and fabricate the state space through a set of correct state transitions. Moreover, we provide an exhaustive and two heuristic algorithms toward the minimization of the execution cost of an ETL workflow. The heuristic algorithm with greedy characteristics significantly outperforms the other two algorithms for a large set of experimental cases. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10414347
Volume :
17
Issue :
10
Database :
Academic Search Index
Journal :
IEEE Transactions on Knowledge & Data Engineering
Publication Type :
Academic Journal
Accession number :
18239859
Full Text :
https://doi.org/10.1109/TKDE.2005.169