Gt4 as an implementation kernel for naregi grid mw beta 1 l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 24

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1 PowerPoint PPT Presentation


  • 149 Views
  • Uploaded on
  • Presentation posted in: General

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1 . Satoshi Matsuoka Professor, Global Scientific Information and Computing Center, Deputy Director, NAREGI Project Tokyo Institute of Technology / NII. Nanotech Grid Apps. (Biotech Grid Apps). (Other Apps). “NanoGrid” IMS ~10TF.

Download Presentation

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Gt4 as an implementation kernel for naregi grid mw beta 1 l.jpg

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1

Satoshi Matsuoka

Professor, Global Scientific Information and Computing Center,

Deputy Director, NAREGI Project

Tokyo Institute of Technology / NII


National research grid infrastructure naregi 2003 2007 l.jpg

NanotechGrid Apps

(Biotech

Grid Apps)

(OtherApps)

“NanoGrid”IMS ~10TF

(BioGridRIKEN)

Other

Inst.

National ResearchGrid Middleware R&D

National AAA Infr.

Grid Middleware R&D

Grid R&D Infrastr.15 TF => 100TF

SuperSINET

National Research Grid Infrastructure (NAREGI) 2003-2007

  • Petascale Grid Infrastructure R&D for Future Deployment

    • $45 mil (US) + $16 mil x 5 (2003-2007) = $125 mil total

    • PL: Ken Miura (FujitsuNII)

      • Sekiguchi(AIST), Matsuoka(Titech), Shimojo(Osaka-U), Aoyagi (Kyushu-U)…

    • Participation by multiple (>= 3) vendors, Fujitsu, NEC, Hitachi, NTT, etc.

    • NOT AN ACADEMIC PROJECT, ~100FTEs

    • Follow and contribute to GGF Standardization, esp. OGSA

NEC

Focused “Grand Challenge” Grid Apps Areas

Osaka-U

Titech

AIST

Fujitsu

IMS

Hitachi

U-Kyushu


Naregi middleware roadmap l.jpg

FY2003

FY2004

FY2005

FY2006

FY2007

Development and

Integration of

αrelease

NAREGI Middleware Roadmap

UNICORE/Globus/Condor-based R&D Framework

Globus4/OGSA/WSRF-based R&D Framework

Utilization of NAREGI-Wide Area Testbed

Utilization of NAREGI NII-IMS Testbed

Version

1.0

Release

Prototyping

NAREGI Middleware

Components

Apply Component

Technologies to

Nano Apps and

Evaluation

Development and deployment of β1, 2, 3,…

Evaluation of α

release in NII-IMS

Testbed

β1 Release

(public)OGSA/WSRF/GT4GGF17

Evaluation of βRelease

By IMS and other

Collaborating Institutes

αRelease

(internal)OGSA(subset)/Unicore+GT2/3/3.9

Development and

Integration of

βrelease

Evaluation on

NAREGI Wide-area

Testbed

Development of

OGSA-based MWbeta 1, 2,

Verification

& Evaluation

Of Ver. 1

Midpoint

Evaluation


Slide4 l.jpg

NII

Research

Organizations

IMS

etc

NAREGI Software Stack (Alpha 2005)

Grid-Enabled Nano-Applications

Grid PSE

Grid Visualization

Grid Programing

-Grid RPC

-Grid MPI

Grid Workflow

Distributed

Information Service

Packaging

Super Scheduler

(UNICORE4, GT2/3/3.9, CondorOGSA)

Grid VM

High-Performance & Secure Grid Networking

SuperSINET

Computing Resources


Slide5 l.jpg

NAREGI Software Stack (beta 1 2006)

Grid-Enabled Nano-Applications (WP6)

Grid PSE

Grid Visualization

Grid Programming (WP2)

-Grid RPC

-Grid MPI

WP3

Grid Workflow (WFML (Unicore+ WF))

Distributed

Information Service(CIM)

Data (WP4)

Super Scheduler

WP1

Packaging

(WSRF (GT4+Fujitsu WP1) + GT4 and other services)

Grid VM (WP1)

Grid Security and High-Performance Grid Networking(WP5)

SuperSINET

NII

Research

Organizations

IMS

Major University Computing Centers

Computing Resources and Virtual Organizations


Highlights of naregi beta may 2006 ggf17 gridworld l.jpg

Highlights of NAREGI Beta (May 2006, GGF17/GridWorld)

  • Professionally developed and tested

  • “Full” OGSA-EMS incarnation

    • Full C-based WSRF engine (Java -> Globus 4)

    • OGSA-EMS/RSS WSRF components

    • Full WS-Agreement brokering and co-allocation

    • GGF JSDL1.0-based job submission, authorization, etc.

    • Support for more OSes (AIX, Solaris, etc.) and BQs

  • Sophisticated VO support for identity/security/monitoring/accounting (extensions of VOMS/MyProxy, WS-* adoption)

  • WS- Application Deployment Support via GGF-ACS

  • Comprehensive Data management w/Grid-wide FS

  • Complex workflow (NAREGI-WFML) for various coupled simulations

  • Overall stability/speed/functional improvements

  • To be interoperable with EGEE, TeraGrid, etc. (beta2)


List of naregi standards beta 1 and beyond l.jpg

GGF Standards and Pseudo-standard Activities set/employed by NAREGI

GGF “OGSA CIM profile”

GGF AuthZ

GGF DAIS

GGF GFS (Grid Filesystems)

GGF Grid CP (GGF CAOPs)

GGF GridFTP

GGF GridRPC API (as Ninf-G2/G4)

GGF JSDL

GGF OGSA-BES

GGF OGSA-Byte-IO

GGF OGSA-DAI

GGF OGSA-EMS

GGF OGSA-RSS

GGF RUS

GGF SRM (planned for beta 2)

GGF UR

GGF WS-I RUS

GGF ACS

GGF CDDLM

Other Industry Standards Employed by NAREGI

ANSI/ISO SQL

DMTF CIM

IETF OCSP/XKMS

MPI 2.0

OASIS SAML2.0

OASIS WS-Agreement

OASIS WS-BPEL

OASIS WSRF2.0

OASIS XACML

De Facto Standards / Commonly Used Software Platforms Employed by NAREGI

Ganglia

GFarm 1.1

Globus 4 GRAM

Globus 4 GSI

Globus 4 WSRF (Also Fujitsu WSRF for C binding)

IMPI (as GridMPI)

Linux (RH8/9 etc.), Solaris (8/9/10), AIX, …

MyProxy

OpenMPI

Tomcat (and associated WS/XML standards)

Unicore WF (as NAREGI WFML)

VOMS

List of NAREGI “Standards”(beta 1 and beyond)


Role of gt4 in naregi grid mw stack beta 1 l.jpg

Role of GT4 in NAREGI Grid MW stack beta 1

GT4 as Implementation Kernel

  • As underlying WSRF engine for OGSA and other WS components

  • Various Globus services used throughout to implement OGSA and other GGF “standard” components and functionalities in all WPs

    • GSI, WS-GRAM, GridFTP, RFT

    • OGSA-DAI, MyProxy

  • In a way, NAREGI MW “glues” GT4 services and some GGF OGSA “standards”


Naregi beta 1 sss architecture an extended ogsa ems incarnation l.jpg

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

JSDL

NAREGI beta 1 SSS ArchitectureAn extendedOGSA-EMS Incarnation

Abbreviation

SS: Super Scheduler

JSDL: Job Submission Description Document

JM: Job Manager

EPS: Execution Planning Service

CSG: Candidate Set Generator

RS: Reservation Service

IS: Information Service

SC: Service Container

AGG-SC: Aggregate SC

GVM-SC: GridVM SC

FTS-SC: File Transfer Service SC

BES: Basic Execution Service I/F

CES: Co-allocation Execution Service I/F (BES+)

CIM: Common Information Model

GNIS: Grid Network Information Service

NAREGI-WP3 WorkFlowTool, PSE, GVS

NAREGI-

WFML

Submit

Cancel

Status

Delete

JSDL

NAREGI JM(SS)Java I/F module

CreateActivity(FromBPEL)

GetActivityStatus

RequestActivityStateChanges

Submit

Status

Delete

Cancel

WFML2BPEL

BPEL2WFST

JM-Client

BPEL (include JSDL)

S

Invoke EPS

CES

SS

Invoke SC

NAREGI JM (BPEL Engine)

SelectResource

FromJSDL

CreateActivity(FromJSDL)

GetActivityStatus

RequestActivityStateChanges

JSDL

MakeReservation

CancelReservation

R

S

EPS

CES

GenerateCandidate

Set

AGG-SC

/RS

MakeReservation

CancelReservation

GetGroups-OfNodes

JSDL

JSDL

CSG

R

S

JSDL

Generate

SQL Query

From JSDL

R

S

CES

R

S

JSDL

CES

CES

JSDL

JSDL

JSDL

Fork/Exec

FTS-SC

SC(GVM-SC)

Fork/Exec

Fork/Exec

SC(GVM-SC)

is-query

globusrun-ws

globusrun-ws

GRAM4 specific

Fork/Exec

OGSA-DAI

GRAM4 specific

GFarmserver

SC

GridVM

SC

GridVM

uber-ftp

WS-GRAM

GNIS

WS-GRAM

CIM

IS

globus-url-copy

DB PostgreSQL

PBS, LoadLeveler

PBS, LoadLeveler

Co-allocation

FileTransfer


Wsrf interoperability l.jpg

WSRF Interoperability

  • Most of NAREGI-SS is implemented as C WSRF component on NAREGI WSRF ToolKit (NWK), which complies to the latest WSRF spec

  • Other NAREGI WSRF components are typically Java and runs on top of GT4 WSRF, which complies to the previous candidate spec

  • Fortunately, NWK and GT4 WSRFs interoperate quite well, with very minor workarounds (!)


Naregi info service beta architecture l.jpg

NAREGI Info Service (beta) Architecture

・ CIMOM Service classifies info according to CIM based schema.

・ The info is aggregated and accumulated in RDBs hierarchically.

・ Client library utilizes OGSA-DAI client toolkit.

・ Accounting info is accessed through RUS.

Information Service Node

User

Admin.

Viewer

CIM Providers

Aggregator

Service

Data

Service

Java-API

OS

Client

(Resource

Broker etc.)

Processor

Light-

weight

CIMOM

Service

Client

Library

Grid

VM

File System

Job Queue

RDB

Performance

Resource

Usage

Service

Ganglia

 ●

Chargeable

Service

(GridVM etc.)

ACL

Node A

Node B

Node C

Parallel Query …

RUS::insertURs

… Hierarchical filtered aggregation

Client

(publisher)

Cell Domain

Information Service

Cell Domain

Information Service


Naregi is standards employed in the architecture l.jpg

NAREGI IS: Standards Employed in the Architecture

User

Admin.

Viewer

Information Service Node

Information Service Node

Client

(OGSA-

RSS etc.)

Distributed

Information Service

GT4.0.1

Tomcat 5.0.28

Aggregator

Service

Java-API

OGSA-DAI

WSRF2.1

Client

library

CIM Providers

CIM spec.

CIM/XML

APP

OGSA-DAI

Client toolkit

OS

APP

Processor

WS-I

RUS

RDB

Light-

weight

CIMOM

Service

Grid

VM

File System

CIM Schema

2.10

/w extension

Job Queue

Performance

ACL

Ganglia

GridVM

(Chargeable

Service)

 ●

Node A

Node B

Node C

RUS::insertURs

... Distributed Query …

… Hierarchical filtered aggregation

GGF/

UR

Client

(OGSA-

BES etc.)

GGF/

UR

Cell Domain

Information Service

Cell Domain

Information Service


Naregi gridvm beta architecture l.jpg

NAREGI GridVM (beta) Architecture

  • Virtual execution environment on each site

    • Virtualization of heterogeneous resources

    • Resource and job management services with unified I/F

Super

Scheduler

Information

Service

Advance reservation,

Monitoring, Control

Resource

Info.

GRAM4

WSRF I/F

GRAM4

WSRF I/F

GridVM Scheduler

GridVM Scheduler

Local Scheduler

Local Scheduler

GridVM Engine

GridVM Engine

GridMPI

Accounting

Sandbox

Job Execution

site

Policy

site

Policy

AIX/LoadLeveler

Linux/PBSPro


Naregi gridvm standards employed in the architecture l.jpg

NAREGI GridVM: Standards Employed in the Architecture

Super

Scheduler

Information

Service

GT4 GRAM-integration and

WSRF-based extension services

CIM-based

resource info.

provider

Job submission based on JSDL

and NAREGI extensions

GRAM4

WSRF I/F

GRAM4

WSRF I/F

GridVM Scheduler

GridVM Scheduler

Local Scheduler

Local Scheduler

GridVM Engine

GridVM Engine

GridMPI

UR/RUS-based

job accounting

site

Policy

site

Policy

xacml-like access control policy


Gt4 gram gridvm integration l.jpg

GT4 GRAM-GridVM Integration

  • Integrated as an extension module to GT4 GRAM

  • Aim to make the both functionalities available

SS

Site

globusrun

RSL+JSDL’

GridVMJobFactory

Extension Service

GridVMJob

Basic job management

+ Authentication, Authorization

SUDO

GRAM

services

GRAM

Adapter

GridVM

scheduler

Delegate

Transfer

request

Scheduler Event Generator

Delegation

Local scheduler

RFT File Transfer

GridVM

Engine


Ninf g a reference implementation of the ggf gridrpc api l.jpg

Large scale computing across

supercomputers on the Grid

Utilization of remote

supercomputers

② Notify results

Internet

user

① Call remote

procedures

Call remote libraries

Ninf-G: A Reference Implementation of the GGF GridRPC API

  • What is GridRPC?

    • Programming model using RPCs on a Grid

    • Provide easy and simple programming interface

    • The GridRPC API is published as a proposed recommendation (GFD-R.P 52)

  • What is Ninf-G?

    • A reference implementation of the standard GridRPC API

    • Built on the Globus Toolkit

    • Now in NMI Release 8 (first non-US software in NMI)

  • Easy three steps to make your program Grid aware

    • Write IDL file that specifies interface of your library

    • Compile it with an IDL compiler called ng_gen

    • Modify your client program to use GridRPC API


Architecture of ninf g l.jpg

Connect back

Invoke

Executable

Architecture of Ninf-G

Client side

Server side

IDL file

Numerical

Library

Client

IDL Compiler

Generate

Globus-IO

Interface

Request

Interface

Reply

WS/Pre-WS GRAM

NAREGI-SS

Remote Library

Executable

MDS2/4

Interface Information

LDIF File

retrieve


Slide18 l.jpg

WorkflowService

ApplicationContentsService

CFDVisualizationService

DeploymentService

MolecularVisualizationService

ParallelVisualizationService

(ACS)

  • compile

  • deploy

  • un-deploy

CFDVisualizer

MolecularViewer

ApplicationRepository

ParallelVisualizer

Grid Application Environment(WP3)

NAREGI Portal

Bio VO

Portal GUI

Portal GUI

Nano VO

Grid PSE

Grid Workflow

Grid Visualization

Deployment UI

Register UI

Workflow GUI

Visualization GUI

Gateway Services

NAREGI-

WFML

File/ExecutionManager

JM I/F module

BPEL+JSDL

Core Grid Services

FileTransfer

(RFT)

UnderlyingGrid Services

Workflow Engine &Super Scheduler

DistributedInformation Service

VOMSMyProxy

GridFile System

・・・

・・・

WSRF


Naregi data grid beta1 architecture wp4 l.jpg

NAREGI Data Grid beta1 Architecture (WP4)

Grid Workflow

Job 1

Job 2

Job n

Data Grid

Components

Data 1

Data 2

Data n

Import data into workflow

Data Access

Management

Place & register data on the Grid

Job 1

Job 2

Metadata

Management

Assign metadata to data

Grid-wide Data Sharing Service

Meta-

data

Meta-

data

Job n

Meta-

data

Data Resource

Management

Data 1

Data 2

Data n

Store data into distributed file nodes

Grid-wide File System


Naregi wp4 standards employed in the architecture l.jpg

NAREGI WP4: Standards Employed in the Architecture

Workflow (NAREGI WFML =>BPEL+JSDL)

Data Access

Management

Job 1

Job n

Import data into workflow

Tomcat

5.0.28

Data 1

Data n

Place data on the Grid

Super Scheduler

(SS) (OGSA-RSS)

Globus

Toolkit

4.0.1

Data Staging

OGSA-RSSFTS SC

Metadata

Construction

GGF-SRM (beta2)

Computational Nodes

GridFTP

Data Resource Management

OGSA-DAI

WSRF2.0

Job 2

Job n

Job 1

OGSA-DAI

WSRF2.0

PostgreSQL 8.0

Data 1

Data 2

Data n

PostgreSQL 8.0

Data Specific

Metadata DB

Data Resource

Information DB

Filesystem

Nodes

Gfarm 1.2 PL4(Grid FS)


Naregi wp4 standards l.jpg

NAREGI WP4 Standards

  • GGF Standards we help set within a WG

    • Grid FileSystems WG (discussion about functionality and usecase scenario)

  • GGF and related Standards we employ

    • OGSA-DAI

    • OGSA-RSS

    • GridFTP

    • WSRF 2.0

    • JSDL

    • SRM (planned for beta 2)

  • Other industry standards we employ

    • BPEL

  • Other de-facto “standards” we employ

    • Globus 4

    • Tomcat (and associated WS/XML standards)


Slide22 l.jpg

MyProxy

Proxy

Certificate

with VO

Super Scheduler

SS client

User

Certificate

Private

Key

Client Environment

Proxy

Certificate

with VO

Information

Service

Portal

WFT

Proxy

Certificate

with VO

Resources Info

incl. VO

PSE

GVM

NAREGI-beta1 Security Architecture(WP5)

Subset of WebTrust

Programs for CA

GRID CP

(GGF CAOPs)

VO、Certificate

Management Service

Resource Info.

(Incl. VO info)

CP/CPS

Audit Criteria

VOMS

query

(requirements

+VO info)

resources

in the VO

NAREGI

CA

ProxyCertificate

with VO

voms-myproxy-init

Put ProxyCertificate

with VO

Get VOMS Attribute

CA Service

Certificate

Management Server

Proxy

Certificate

withVO

globusrun-ws

GridVM services

(incl. GSI)

Request/Get

Certificate

ssh + voms-myproxy-init

VO Info、Execution Info,

Resource Info

Resource

GridVM

local Info.

incl. VO

log-in

Signed

Job

Description


Slide23 l.jpg

Mediator

A

Mediator

B

Mediator

A

Mediator

A

Mediator

B

NAREGI Application Mediator (WP6) for Coupled Applications

Workflow

NAREGI WFT

Mediator Components

co-allocated jobs

Support data exchange between coupled simulation

Simulation A

Simulation A

Simulation A

Mediator

Mediator

Mediator

Job n

Job 1

Data transfer

management

Simulation B

Simulation A

Simulation A

Information

Service

・Synchronized

file transfer

Super Scheduler

SQL

・Multiple protocol

GridFTP/MPI

GridVM

GridVM

GridVM

SBC* -XML

・Global Job ID

・Allocated nodes

・Transfer Protocol

etc.

API

Data transformation

management

API

Sim.B

Sim.A

Data1

・Semantic transform-

ation libraries for

different simulations

OGSA-DAI

WSRF2.0

Data3

Sim.A

Data2

JNI

Sim.B

・Coupled accelerator

Sim.A

Globus

Toolkit

4.0.1

GridFTP

GridFTP

MPI

*SBC: Storage-based communication

MPI

MPI


Summary and future l.jpg

Summary and Future

  • NAREGI beta 1 will be publicly released at [email protected], May 2006

  • GT4 has served as robust, scalable, and reliable implementation kernels for OGSA and other GGF standards services

  • Plan to work with the GT team to enhance OGSA features, exploit advanced functionalities (already budgeted for FY06)

    • Enhance ES-GRAM, in particular default JSDL integration, reservation/co-scheduling

    • CIM/GLUE interoperable information Model and MDS4

    • Workspace Service and GridVM

    • Etc…


  • Login