EGGE UF4 / OGF25
This presentation is the property of its rightful owner.
Sponsored Links
1 / 10

EGEE UF4/OGF25 Catania, Italy March 2 nd , 2009 PowerPoint PPT Presentation


  • 91 Views
  • Uploaded on
  • Presentation posted in: General

EGGE UF4 / OGF25 Catania (Italy), March 2 nd , 2009. State and Future Plans for GridWay Metascheduler. EGEE UF4/OGF25 Catania, Italy March 2 nd , 2009. Eduardo Huedo. Contents. Architecture Components Scheduling Policies Interoperation through Adapters Infrastructures Using GridWay

Download Presentation

EGEE UF4/OGF25 Catania, Italy March 2 nd , 2009

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Egee uf4 ogf25 catania italy march 2 nd 2009

EGGE UF4 / OGF25

Catania (Italy), March 2nd, 2009

State and Future Plans for GridWay Metascheduler

EGEE UF4/OGF25

Catania, Italy

March 2nd, 2009

Eduardo Huedo


Contents

Contents

  • Architecture

  • Components

  • Scheduling Policies

  • Interoperation through Adapters

  • Infrastructures Using GridWay

  • Status and Future Plans

  • More Information


Architecture

Architecture

GridWay

DRMAA

  • LRM-like Command Line Interface

  • OGF DRMAA C, Java, Perl… bindings

  • OGF JSDL (POSIX & HTC profiles)

  • Job arrays, DAG workflows and MPI jobs

$>

Applications

CLI

Application-Infrastructure decoupling

.C, .java

.C, .java

  • Advanced scheduling policies

  • Accounting

  • Fault detection & recovery

Grid Meta-

Scheduler

  • Straightforwarddeployment

  • Deploy different kinds of grids

  • Interoperation between grids

Globus

Services

Grid Middleware

  • Highly dynamic & heterogeneous

  • High fault rate

Infrastructure

PBS

SGE


Components

Components

MDS2

MDS2

GLUE

MDS4

GridFTP

RFT

pre-WS

GRAM

WS

GRAM

DRMAA library

CLI

Job Submission

Job Monitoring

Job Control

Job Migration

GridWay Core

Request

Manager

Job Pool

Host Pool

Dispatch

Manager

Scheduler

Transfer

Manager

Execution

Manager

Information

Manager

Job Preparation

Job Termination

Job Migration

Resource Discovery

Resource Monitoring

Information

Services

File Transfer

Services

Execution

Services


Scheduling policies

Scheduling Policies

  • Rank Expressions

  • Fixed Priority

  • User Usage History

  • Failure Rate

Resource Policies

Grid Scheduling = Job + Resource Policies

Matching resources for each job (user)

Pending

Jobs

Job Policies

  • Fixed Priority

  • Urgent Jobs

  • User Share

  • Deadline

  • Waiting Time


Interoperation through adapters

Interoperation through Adapters

  • Different execution interfaces (GRAM2, GRAM4, CREAM, ARC...)

  • Different cluster configurations (shared FS or not)

  • Different transfer models (direct, reverse)

  • Different information models (Globus, GLUE...)

  • A&A through globally recognized CAs and DN’s

Users

GridWay

gLite

Globus

Globus

gLite

Globus

Globus

SGE Cluster

PBS Cluster

SGE Cluster

PBS Cluster

SGE Cluster

PBS Cluster


Interoperation through adapters1

Interoperation through Adapters

  • A real example of gwhost output (OGF23 demo):


Infrastructures using gridway

Infrastructures Using GridWay


Status and future plans

Status and Future Plans

  • Latest developments (for GridWay 5.5)

    • A single account to manage several grid users/proxies, useful for portals

    • Execution adapter for CREAM

    • Improved information adapter for EGEE

  • Other developments (related components)

    • Information and execution adapters for ARC, thanks to Dmytro Karpenko (BITP)

    • Execution adapter for SGE, thanks to CESGA

    • Plug-in for SLA negotiation, thanks to BEinEIMRT project

  • Future developments

    • Scheduling policies for federated grids

    • Execution adapter for DRMAA, i.e. for any DRMS supporting it

    • Adapters for UNICORE

    • Data caching and data management


More information

More Information

  • Guides, howtos, mailing lists...

    • http://www.gridway.org

  • Globus guides

    • http://www.globus.org/toolkit/docs/4.2/4.2.0/execution/gridway

  • Open community development process

    • http://dev.globus.org/wiki/GridWay

  • Research publications

    • http://dsa-research.org

  • More about GridWay at EGEE UF4/OGF25

    • Tutorial about "Porting Applications with Globus GridWay”, here! next!

    • Presentation "Vashra-T: Grid Ray Tracing for the Fusion Physics ASTRA Code", Tuesday 14:25

    • Presentation "Porting AITALC product through a master/worker scheme", Wednesday 14:00

    • Poster "Support for CREAM-based CEs in GridWay Metascheduler“, Tuesday 16:00

  • Any question now?


  • Login