Dynamic multi phase scheduling for heterogeneous clusters

Ciorba, FM; Andronikos, T; Riakiotakis, I; Chronopoulos, AT; Papakonstantinou, G

dc.contributor.author	Ciorba, FM	en
dc.contributor.author	Andronikos, T	en
dc.contributor.author	Riakiotakis, I	en
dc.contributor.author	Chronopoulos, AT	en
dc.contributor.author	Papakonstantinou, G	en
dc.date.accessioned	2014-03-01T02:44:01Z
dc.date.available	2014-03-01T02:44:01Z
dc.date.issued	2006	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/31620
dc.subject	Concurrent Programs	en
dc.subject	Distributed Computing System	en
dc.subject	Dynamic Scheduling	en
dc.subject	Heat Equation	en
dc.subject	Heterogeneous Cluster	en
dc.subject	Heterogeneous Computing	en
dc.subject	Heterogeneous Distributed System	en
dc.subject	Indexing Terms	en
dc.subject	Load Balance	en
dc.subject	Loop Scheduling	en
dc.subject	Nested Loops	en
dc.subject	Parallel Computer	en
dc.subject.other	Distributed computing systems	en
dc.subject.other	Dynamic scheduling	en
dc.subject.other	Floyd-Steinberg algorithm	en
dc.subject.other	Load balancing	en
dc.subject.other	Database systems	en
dc.subject.other	Distributed computer systems	en
dc.subject.other	Iterative methods	en
dc.subject.other	Parallel processing systems	en
dc.subject.other	Synchronization	en
dc.subject.other	Scheduling	en
dc.title	Dynamic multi phase scheduling for heterogeneous clusters	en
heal.type	conferenceItem	en
heal.identifier.primary	10.1109/IPDPS.2006.1639308	en
heal.identifier.secondary	http://dx.doi.org/10.1109/IPDPS.2006.1639308	en
heal.identifier.secondary	1639308	en
heal.publicationDate	2006	en
heal.abstract	Distributed computing systems are a viable and less expensive alternative to parallel computers. However, concurrent programming methods in distributed systems have not been studied as extensively as for parallel computers. Some of the main research issues are how to deal with scheduling and load balancing of such a system, which may consist of heterogeneous computers. In the past, a variety of dynamic scheduling schemes suitable for parallel loops (with independent iterations) on heterogeneous computer clusters have been obtained and studied. However, no study of dynamic schemes for loops with iteration dependencies has been reported so far. In this work we study the problem of scheduling loops with iteration dependencies for heterogeneous (dedicated and non-dedicated) clusters. The presence of iteration dependencies incurs an extra degree of difficulty and makes the development of such schemes quite a challenge. We extend three well known dynamic schemes (CSS, TSS and DTSS) by introducing synchronization points at certain intervals so that processors compute in pipelined fashion. Our scheme is called dynamic multi-phase scheduling (DMPS) and we apply it to loops with iteration dependencies. We implemented our new scheme on a network of heterogeneous computers and studied its performance. Through extensive testing on two real-life applications (the heat equation and the Floyd-Steinberg algorithm), we show that the proposed method is efficient for parallelizing nested loops with dependencies on heterogeneous systems. © 2006 IEEE.	en
heal.journalName	20th International Parallel and Distributed Processing Symposium, IPDPS 2006	en
dc.identifier.doi	10.1109/IPDPS.2006.1639308	en
dc.identifier.volume	2006	en