1 / 10

A Grid Scheduler based on Clustering Technique Israel Hernandez May 20 th , 2004

A Grid Scheduler based on Clustering Technique Israel Hernandez May 20 th , 2004. Institute for Computing Systems Architecture School of Informatics , University of Edinburgh. A Grid Scheduler based on Clustering Technique. Motivation.

Download Presentation

A Grid Scheduler based on Clustering Technique Israel Hernandez May 20 th , 2004

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. A Grid Scheduler based on Clustering TechniqueIsrael HernandezMay 20th, 2004 Institute for Computing Systems ArchitectureSchool of Informatics, University of Edinburgh A Grid Scheduler based on Clustering Technique

  2. Motivation • A Grid computational environment is suitable for parallel applications. In spite of such suitability few users currently execute their parallel applications on Grid. • Mainly reason is that Grid environment has two distinct characteristics: heterogeneous and dynamic. • The Grid Scheduling problem is classified as NP-complete problem and optimal algorithms in polynomial time are known for restricted cases. • We investigate scheduling techniques which respond to dynamic resources availability. A Grid Scheduler based on Clustering Technique

  3. A Grid Scheduler based on Clustering Technique The objective of Grid Scheduler is to minimize the completion time of a parallel application by properly allocating the tasks onto processors. A Grid Scheduler based on Clustering Technique

  4. The Directed Acyclic Graph (DAG)model w(n1) • Each node represent a task, and the weight of node ni, w(ni) is call the computation cost, usually the execution time of the task. n1 e(n1,n2) e(n1,n4) e(n1,n3) • The edges represents a message transferred from node i to node j. The weight of • an edge is called the communication cost of the edge and is denoted by e(ni,nj). w(n2) n2 w(n4) w(n3) n3 n4 e(n4,n6) e(n2,n5) w(n5) n6 w(n6) n5 e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique

  5. The Directed Acyclic Graph (DAG) model Heterogeneous Homogeneous w(n1,r1), w(n1,r2), … ,w(n1,rn) w(n1) n1 n1 e((n1, r1,),(n2,r1)), .. , e((n1, r1),(n2,rn)), e((n1, r2,),(n2,r1)), .. , e((n1, r2),(n2,rn)), ………….. e((n1, rn,),(n2,r1)), .. , e((n1, rn,),(n2,rn)) e(n1, n2) n2 n2 w(n2,r1), w(n2,r2), … ,w(n2,rn) w(n2) A Grid Scheduler based on Clustering Technique

  6. The Clustering Technique w(n1) 1.- Clustering At the beginning of the scheduling process each node in the DAG is considered a cluster. In the subsequent steps, two nodes are merged into a cluster if the merging reduces the completion time. The process of merging continues until no further improvements are possible. n1 e(n1,n2) e(n1,n4) e(n1,n3) n2 w(n4) w(n3) n3 n4 w(n5) n6 w(n6) n5 2.- Allocation. The next step is to allocate the clusters onto processors. e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique

  7. The Clustering Technique w(n1) 1.- Clustering At the beginning of the scheduling process each node in the DAG is considered a cluster. In the subsequent steps, two nodes are merged into a cluster if the merging reduces the completion time. The process of merging continues until no further improvements are possible. n1 e(n1,n2) e(n1,n4) e(n1,n3) n2 w(n4) w(n3) n3 n4 w(n5) n6 w(n6) n5 2.- Allocation. The next step is to allocate the clusters onto processors. e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique

  8. The Clustering Technique w(n1) 1.- Clustering At the beginning of the scheduling process each node in the DAG is considered a cluster. In the subsequent steps, two nodes are merged into a cluster if the merging reduces the completion time. The process of merging continues until no further improvements are possible. n1 e(n1,n2) e(n1,n4) e(n1,n3) n2 w(n4) w(n3) n3 n4 w(n5) n6 w(n6) n5 2.- Allocation. The next step is to allocate the clusters onto processors. e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique

  9. Grid Resource Discovery Application Problem DAG Cluster Creation Algorithm Cluster Allocation Algorithm A Grid Scheduler based on Clustering Technique Resource Mapping Function DAG information Clusters Allocation of Clusters onto processors Grid Processors status Heterogeneous Computational Resources Processes A Grid Scheduler based on Clustering Technique

  10. Institute for Computing Systems ArchitectureSchool of Informatics, University of Edinburgh T H A N K S A Grid Scheduler based on Clustering Technique

More Related