ETL workflows: From formal specification to optimization

Sellis, TK; Simitsis, A

dc.contributor.author	Sellis, TK	en
dc.contributor.author	Simitsis, A	en
dc.date.accessioned	2014-03-01T02:44:36Z
dc.date.available	2014-03-01T02:44:36Z
dc.date.issued	2007	en
dc.identifier.issn	03029743	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/31902
dc.subject	Conceptual Model	en
dc.subject	Data Warehouse	en
dc.subject	Design and Implementation	en
dc.subject	Formal Specification	en
dc.subject	Extract Transform Load	en
dc.subject.other	Customization	en
dc.subject.other	Deployment stage	en
dc.subject.other	Formal specification	en
dc.subject.other	Automation	en
dc.subject.other	Data warehouses	en
dc.subject.other	Mathematical models	en
dc.subject.other	Ontology	en
dc.subject.other	Semantics	en
dc.subject.other	Optimization	en
dc.title	ETL workflows: From formal specification to optimization	en
heal.type	conferenceItem	en
heal.identifier.primary	10.1007/978-3-540-75185-4_1	en
heal.identifier.secondary	http://dx.doi.org/10.1007/978-3-540-75185-4_1	en
heal.publicationDate	2007	en
heal.abstract	In this paper, we present our work on a framework towards the modeling and optimization of Extraction-Transformation-Loading (ETL) workflows. The goal of this research was to facilitate, manage, and optimize the design and implementation of the ETL workflows both during the initial design and deployment stage, as well as, during the continuous evolution of a data warehouse. In particular, we present our results which include: (a) the provision of a novel conceptual model for the tracing of inter-attribute relationships and the respective ETL transformations in the early stages of a data warehouse project, along with an attempt to use ontology-based mechanisms to semi-automatically capture the semantics and the relationships among the various sources; (b) the provision of a novel logical model for the representation of ETL workflows with two main characteristics: genericity and customization; (c) the semi-automatic transition from the conceptual to the logical model for ETL workflows; and (d) the tuning of an ETL workflow for the optimization of the execution order of its operations. Finally, we discuss some issues on future work in the area that we consider important and a step towards the incorporation of the above research results to other areas as well. © Springer-Verlag Berlin Heidelberg 2007.	en
heal.journalName	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)	en
dc.identifier.doi	10.1007/978-3-540-75185-4_1	en
dc.identifier.volume	4690 LNCS	en
dc.identifier.spage	1	en
dc.identifier.epage	11	en