load balancing and grid computing l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Load Balancing and Grid Computing PowerPoint Presentation
Download Presentation
Load Balancing and Grid Computing

Loading in 2 Seconds...

play fullscreen
1 / 18

Load Balancing and Grid Computing - PowerPoint PPT Presentation


  • 319 Views
  • Uploaded on

Load Balancing and Grid Computing. David Finkel Computer Science Department Worcester Polytechnic Institute. References. “The Anatomy of the Grid”, Ian Foster, Carl Kesselman, Steven Tuccke, International Journal of Supercomputer Applications, 2001

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Load Balancing and Grid Computing' - issac


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
load balancing and grid computing

Load Balancing and Grid Computing

David Finkel

Computer Science Department

Worcester Polytechnic Institute

references
References
  • “The Anatomy of the Grid”, Ian Foster, Carl Kesselman, Steven Tuccke, International Journal of Supercomputer Applications, 2001
  • “A Performance Oriented Migration Framework for the Grid”, Satish S. Vadhiyar and Jack J. Dongarra, Proceedings of CCGrid 2003, Third IEEE/ACM International Symposium on Cluster Computing and the Grid
  • Innumerable papers by PEDS members Finkel, Wills and Finkel, and Claypool and Finkel, with additional co-authors.
what is the grid foster et al paper
What is the Grid? (Foster et al paper)
  • Distributed computing infrastructure for advanced science and engineering
  • Runs over the Internet, potentially world-wide
  • Several approaches have emerged: Paper discusses Globus Toolkit
the grid concept
The Grid Concept
  • Coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations.
  • Highly controlled, with resource providers and consumers defining what is shared and the conditions of sharing.
  • Issues to address: Protocols, privacy, security, costs, …
related approaches
Related approaches
  • Application Service Providers
  • Storage Service Providers
  • CORBA
  • DCE
  • Volunteer Computing (SETI @ home, Distriblets, SLINC)
fabric layer
Fabric Layer
  • Provides access and control to resources
  • Resources: Computational, storage, network
  • Enquiry functions: to determine characteristics and state of a resource
  • Management functions: Start, stop computations, reserve bandwidth
collective layer
Collective Layer
  • Protocols and services not associated with a particular resource
    • Directory services for discovery of resources
    • Co-allocation, scheduling, brokering
    • Monitoring the Virtual Organization for failure, intrusion detection, etc.
load sharing overview
Load Sharing - Overview
  • Transferring work from a heavily loaded node to a lightly loaded node
  • Purpose: To improve application performance
  • Transferring processes not suitable for fine-grain parallelism
  • Also known as: Load Balancing, Process Migration.
load sharing issues
Load Sharing Issues
  • Criteria for heavily-loaded, lightly loaded
  • Measuring load (policy, implementation)
  • Exchanging information about load, state
  • Which jobs to transfer
  • When to transfer (new processes only, already-running processes)
load sharing in the grid
Load Sharing in the Grid
  • “A Performance Oriented Migration Framework for the Grid”, Vadhiyar and Donngarra
  • Part of the GrADS project – Grid Application Development System – based at Univ. of Tennessee and other institutions
  • Designed for long-running computations
load sharing in the grid 2
Load Sharing in the Grid - 2
  • Basic idea – the load sharing system can run a performance model of a computation to estimate running time and resource requirements.
  • Application programmer is responsible for providing performance model for the application, and hooks to stop application, checkpoint state, and re-start application.
  • Based on MPI Programming Library, Globus Toolkit
load sharing in the grid 3
Load Sharing in the Grid - 3
  • Before application begins, Application Manager runs performance model to predict execution times, number of processors.
  • Determines whether an appropriate set of processors is available, schedules jobs
  • Monitors process of application as it runs
load sharing in the grid 4
Load Sharing in the Grid - 4
  • Load sharing can occur if
    • Application progress is delayed
    • Additional resources become available
  • App Manager sends message to application so it will
    • Checkpoint
    • Stop computation
  • Re-start on new collection of nodes
research directions
Research Directions
  • Load sharing on the Grid:
    • There’s a large body of pre-Grid research of load balancing in distributed systems
    • Can the results of this research be used to design load balancing systems for the Grid
load balancing and grid computing18

Load Balancing and Grid Computing

David Finkel

Computer Science Department

Worcester Polytechnic Institute