A front-end, Hadoop-based data management service for efficient federated clouds

Kousiouris, G; Vafiadis, G; Varvarigou, T

dc.contributor.author	Kousiouris, G	en
dc.contributor.author	Vafiadis, G	en
dc.contributor.author	Varvarigou, T	en
dc.date.accessioned	2014-03-01T02:52:49Z
dc.date.available	2014-03-01T02:52:49Z
dc.date.issued	2011	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/36097
dc.subject	Apache hadoop	en
dc.subject	Cloud computing	en
dc.subject	Data management	en
dc.subject	Web services	en
dc.subject.other	Apache hadoop	en
dc.subject.other	Cloud data	en
dc.subject.other	Cloud providers	en
dc.subject.other	Cost effective	en
dc.subject.other	Data access	en
dc.subject.other	Data management services	en
dc.subject.other	Data management system	en
dc.subject.other	Data storage	en
dc.subject.other	Distributed computations	en
dc.subject.other	Front-end services	en
dc.subject.other	Geographical locations	en
dc.subject.other	Intelligent decision making	en
dc.subject.other	Large scale computation	en
dc.subject.other	Map-reduce	en
dc.subject.other	Massive data	en
dc.subject.other	Pay-per-use	en
dc.subject.other	Cloud computing	en
dc.subject.other	Computer software	en
dc.subject.other	Data processing	en
dc.subject.other	Data storage equipment	en
dc.subject.other	Fault tolerant computer systems	en
dc.subject.other	Web services	en
dc.subject.other	Information management	en
dc.title	A front-end, Hadoop-based data management service for efficient federated clouds	en
heal.type	conferenceItem	en
heal.identifier.primary	10.1109/CloudCom.2011.76	en
heal.identifier.secondary	http://dx.doi.org/10.1109/CloudCom.2011.76	en
heal.identifier.secondary	6133185	en
heal.publicationDate	2011	en
heal.abstract	In the recent years, cloud computing has emerged as the new IT paradigm that promises elastic resources on a payper-use basis. The challenges of cloud computing are focused around massive data storage and efficient large scale distributed computation. Hadoop, a community driven Apache project has provided an efficient and cost effective platform for large scale computation using the map-reduce methodology, pioneered by Google. In this paper, the design of a Hadoop-based data management system as the front-end service for Cloud data management is investigated. This framework is enriched with RESTful APIs in front of Hadoop and a series of components that aim to extend Hadoop's functionality beyond its well known back-end, heavy data processing scope. These components are used to enrich security, logging and data analysis features and also data access compatibility between different but interconnected Cloud providers (federated Clouds). Hadoop capabilities are also extended in a quest for intelligent decision making regarding the choice of the fittest services for federation in a federated cloud scenario, in addition to legally compliant behaviour regarding the geographical location of data storage. © 2011 IEEE.	en
heal.journalName	Proceedings - 2011 3rd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2011	en
dc.identifier.doi	10.1109/CloudCom.2011.76	en
dc.identifier.spage	511	en
dc.identifier.epage	516	en