A generic and customizable framework for the design of ETL scenarios

Vassiliadis, P; Simitsis, A; Georgantas, P; Terrovitis, M; Skiadopoulos, S

dc.contributor.author	Vassiliadis, P	en
dc.contributor.author	Simitsis, A	en
dc.contributor.author	Georgantas, P	en
dc.contributor.author	Terrovitis, M	en
dc.contributor.author	Skiadopoulos, S	en
dc.date.accessioned	2014-03-01T02:43:03Z
dc.date.available	2014-03-01T02:43:03Z
dc.date.issued	2005	en
dc.identifier.issn	0306-4379	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/31201
dc.subject	Data warehousing	en
dc.subject	ETL	en
dc.subject.classification	Computer Science, Information Systems	en
dc.subject.other	Computer programming languages	en
dc.subject.other	Data acquisition	en
dc.subject.other	Data flow analysis	en
dc.subject.other	Data storage equipment	en
dc.subject.other	Database systems	en
dc.subject.other	Mathematical models	en
dc.subject.other	XML	en
dc.subject.other	Database programming languages	en
dc.subject.other	Extraction-transformation loading (ETL)	en
dc.subject.other	Metamodels	en
dc.subject.other	Workflow-like approach	en
dc.subject.other	Data warehouses	en
dc.title	A generic and customizable framework for the design of ETL scenarios	en
heal.type	conferenceItem	en
heal.identifier.primary	10.1016/j.is.2004.11.002	en
heal.identifier.secondary	http://dx.doi.org/10.1016/j.is.2004.11.002	en
heal.language	English	en
heal.publicationDate	2005	en
heal.abstract	Extraction-transformation-loading (ETL) tools are pieces of software responsible for the extraction of data from several sources, their cleansing, customization and insertion into a data warehouse. In this paper, we delve into the logical design of ETL scenarios and provide a generic and customizable framework in order to support the DW designer in his task. First, we present a metamodel particularly customized for the definition of ETL activities. We follow a workflow-like approach, where the output of a certain activity can either be stored persistently or passed to a subsequent activity. Also, we employ a declarative database programming language, LDL, to define the semantics of each activity. The metamodel is generic enough to capture any possible ETL activity. Nevertheless, in the pursuit of higher reusability and flexibility, we specialize the set of our generic metamodel constructs with a palette of frequently used ETL activities, which we call templates. Moreover, in order to achieve a uniform extensibility mechanism for this library of built-ins, we have to deal with specific language issues. Therefore, we also discuss the mechanics of template instantiation to concrete activities. The design concepts that we introduce have been implemented in a tool, ARKTOS II, which is also presented. (c) 2004 Elsevier B.V. All rights reserved.	en
heal.publisher	PERGAMON-ELSEVIER SCIENCE LTD	en
heal.journalName	Information Systems	en
dc.identifier.doi	10.1016/j.is.2004.11.002	en
dc.identifier.isi	ISI:000230553600002	en
dc.identifier.volume	30	en
dc.identifier.issue	7	en
dc.identifier.spage	492	en
dc.identifier.epage	525	en