Eu indiagrid interoperability status and plans
This presentation is the property of its rightful owner.
Sponsored Links
1 / 23

EU-IndiaGrid Interoperability: status and plans PowerPoint PPT Presentation


  • 98 Views
  • Uploaded on
  • Presentation posted in: General

International Grid Interoperability and Interoperation Workshop (IGIIW07) Bangalore, 10 December 2007. EU-IndiaGrid Interoperability: status and plans. Marco Verlato. Outline. EU-IndiaGrid project overview Objectives Activities 1 st year achievements

Download Presentation

EU-IndiaGrid Interoperability: status and plans

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Eu indiagrid interoperability status and plans

International Grid Interoperability and

Interoperation Workshop (IGIIW07)

Bangalore, 10 December 2007

EU-IndiaGrid Interoperability: status and plans

Marco Verlato


Outline

Outline

  • EU-IndiaGrid project overview

    • Objectives

    • Activities

    • 1st year achievements

  • Interoperability between EGEE and GARUDA

    • Analysis

    • Strategy

    • Some scenarios

  • Conclusions


An egee related project

An EGEE related project


Indian grid projects

Indian Grid Projects

  • India has two main grid infrastructures:

    • The GARUDA National Grid Initiative

    • The Department of Atomic Energy (DAE) Grid

GARUDA Grid

  • Private Network

  • Connecting 45 institutes in 17 cities

  • 100 and 10 Mbps links

4 Mbps

Link

4 Mbps

Link

CAT: archival

storage

VECC: real-time

Data collection

BARC: Computing with shared controls

IGCAR: wide-area

Data dissemination

DAE Grid

(gLite based)


Garuda components

Slide from Natraj C Addekoppa’s talk at Taipei Workshop

GARUDA components

  • Application (PoC)

  • Disaster Management

  • Bioinformatics

  • Management & Monitoring

  • Paryaveekshanam

  • Access Methods

  • Access Portal

  • Problem Solving Environments

  • Data Management

  • Storage Resource Broker

  • Resources

  • Compute, Data, Storage,

  • Scientific Instruments,

  • Softwares,..

  • Development Environment

  • DIViA for Grid

  • Resource Mgmt & Scheduling

  • Moab from Cluster Resources

  • Load Leveler, Torque

  • Globus 2.x

  • Collaborative Environment

  • Video Conferencing over IP

  • Access Grid


Eu indiagrid goals

EU-IndiaGrid goals

  • To support the interconnection and interoperability between EGEE and GARUDA for the benefit of e-Science applications

  • To build an e-Science Network Community:

    • identify and aggregate research, scientific and industrial communities which may benefit from the use of Grid

  • To promote the use of advanced Grid technologies in scientific communities

    • Specific pilot applications (HEP, Biology, Material Science, Earth and Atmospheric Sciences) and dissemination activities

  • Project start: October 2006

  • Duration: 24 months


Participants

PARTICIPANTS

EUROPE

  • INFN (project coordinator)

  • Metaware SpA

  • Italian Academic and Research Network (GARR)

  • Cambridge UniversityINTERNATIONAL

  • Abdu Salam International Centre for Theoretical PhysicsINDIA

  • Indian Education and Research Network (ERNET)

  • University of Pune

  • SAHA Institute of Nuclear Physics, Kolkata

  • Centre for Development of Advanced Computing (C-DAC)

  • Bhabha Atomic Research Centre, Mumbai

  • TATA Institute for Fundamental Research (Mumbai) National Centre for Biological Sciences (Bangalore)

  • Not formally, but concretely: VECC, Kolkata and MIT, Chennai


Activities

Activities


Main 1 st year achievements

Main 1st year achievements

  • Five Project Workshops + several trainings

    • Mumbai, Dec 2006; Bangalore, Apr 2007; Kolkata, Jun 2007; Pune, Sep 2007; Taipei, Nov 2007

  • EU-IndiaGrid Project Conference here this week

  • Enabling exploitation of high bandwidth EU-India network connectivity

    • 45Mbps in October 2006; 1Gbps November 2007

  • Supporting the creation of the National Indian CA

  • Operating the euindia VO and infrastructure with >1200 CPUs , >10 CPU.years consumed by appl.s

  • many scientific applications ported on both GARUDA and EGEE grids see posters at this conference


Interoperability 1

Interoperability/1

  • The 2nd year will be more focused on Interoperability

  • The 1st year was spent in:

    • achieving some pre-requisites:

      • ASGC CA acting as catch-all CA until the Indian National CA is established and approved by APGridPMA

      • Interconnecting GARUDA’s private network with the intercontinental link

    • carefully analysing the gLite and GARUDA middlewares

    • discussing among partners a number of possible interoperability scenarios

    • defining a stepwise strategy to achieve the goal


Interoperability 2

Interoperability/2

  • It was soon recognized the need of:

    • taking advantage from EUChinaGrid experience about interoperability with CNGrid GOS middleware

    • identifying solutions being compliant with consolidated/emerging standards (GLUE, JSDL, OGSA-BES, gridFTP, SRM)

  • Corresponding actions undertaken:

    • EU-Asia Interoperability sessions/workshops/round tables organised at international grid events

      • at EGEE’07 of Budapest, October 2007

      • at WLCG-Tier2/EU-IndiaGrid Workshop of Taipei, November 2007

      • at IGIIW and EU-IndiaGrid Conference of Bangalore, this week

    • Participation to Open Grid Forum Interoperability Panel planned from OGF22, February 2008


Picture taken at mumbai workshop december 2006

Picture taken at Mumbai Workshop, December 2006

ANALYSIS


Mw components analysis

MW components analysis

PORTAL

GSI+

VOMS

UI

GSI+

gridmapfile

MOAB

WMS

BDII

MDS

GLOBUS

JC+LM

LFC

GARUDA-CE

(GT2 based)

lcg-CE

(GT2 based)

SRB

SRM

WN-1

PBS-LikeLRMS

WN-2

Linux + AIX

WN-n


The strategy

The strategy

  • To deploy gLite middleware at Indian partners sites

    • CE and SE deployed at VECC, Kolkata in September 2007

    • First full-fledged gLite testbed deployed at MIT, Chennai in October 2007

    • CDAC-Bangalore and Pune coming soon

  • To implement a “basic” job submission interoperation scenario with the present middleware components

  • To implement a more advanced scenario evaluating/adapting the EUChinaGrid Gateway

  • To implement Data Management interoperation leveraging SRM-SRB interface developed by ASGC

  • To design a true interoperability model based on OGF standards, to be implemented in a future I3 project


Basic job submission interoperation

lcg-CE(Torque)

lcg-CE(Torque)

lcg-CE(Torque)

lcg-CE

In case of AIX sys.could be evaluatedAIX-ENEA solution

Mixed WN:GARUDA + gLite TAR-WN

WNs must supportboth environments

Basic Job submission interoperation

VOMS

GARUDA

portal

gLite (TAR) UI or subset (WMproxy APIs)

gLite UI

gLite WMS

BDII

gLite

Resourcescloud


Enea grid approach to provide access to aix

ENEA-Grid approach to provide access to AIX

  • Can be applied on other contexts, being based on:

  • availability of a shared file system on the site WN and on the GRID Proxy WN

  • use of a remote execution tool for implementing the wrapper

it works also with

NFS or GPFS

it works also with

rsh or ssh

Invasiveness of the grid middleware and

firewall requirements are minimized !


Euchinagrid gateway adapter approach

Slides from Subrata Chattopadhyay’s talk at EGEE’07

EUChinaGrid Gateway/Adapter Approach


Data management interoperation

SRM

SRB

Data Management Interoperation

  • ASGC is developing a SRM interface to SRB

  • DEMO at SC’07

  • Short term plan

    • Implement interface compatible with SRM version 2.2

  • Mid-term plan

    • Interact and test with other data management systems such as Castor, dCache,…,etc.

  • Long-term plan

    • Interoperate with gLite.

      • Hope glite users who join VO can access files and resources in SRB and vice versa.

Thanks to

Fu-Ming Tsai


Architecture overview

Architecture Overview

Thanks to

Fu-Ming Tsai

  • The ICTP team developing StoRM

  • is part of both EU-IndiaGrid and

  • SRM-WG of OGF

  • Possible cooperation with ASGC for:

    • interacting with StoRM

    • deploying/adapting the SRM-SRB interface in EU-IndiaGrid

Users/applications

File transfer (gridftp)

File transfer (gridftp)

SRM API

Core

Web Service

File catalog

Data server management

Gridftp/management API

Gridftp/management API

Cache repository

Cache server

(+gridftp server)

SRB+DSI

SRB/gridftp


Interoperability with ogf standards

Interoperability with OGF standards

  • OMII-Europe EU project is delivering components to enable interoperability across different middlewares:

    • gLite, Globus, UNICORE, OMII-UK and CROWN

  • For gLite-Globus we could use:

    • CREAM-BES: new gLite CE compliant with BES and JSDL, beta release in December, stable release by April

    • GT4 OGSA-BES: pre-alpha version GT4 CE

    • VOMS for the security (compliant with OGF OGSA AuthZ WG )

    • GLUE Schema for the Information System

  • adapting these components to GARUDA and gLite environment requires effort for development  JRAs in I3 EU Projects


Future job submission using jsdl bes standards thanks to moreno marzolla omii europe

CREAM-CLI

BES-CLI

globus

BES

conn.

gLite

BES

conn.

ICE

GT4

GARUDA-CE

(GT4 based)

BES

CREAM-CE

(WS based)

BES

Future job submission using JSDL/BES standards?(thanks to Moreno Marzolla / OMII-EUROPE)

GARUDA

Portal

gLite UI

GSI +

VOMS

GARUDA Scheduler / MOAB

gLite WMS

BDII with

GLUE schema

GLOBUS

JC+ LM

GT2

GARUDA-CE

(GT2 based)

lcg-CE

(GT2 based)


Conclusions

Conclusions

  • The main focus of EU-IndiaGrid Project in its 2nd year will be the interoperability between gLite and GARUDA

  • Several discussions held, several approaches figured out during the 1st year, and a stepwise strategy has been proposed

  • The Project is actively organizing panel sessions, round tables, discussions about interoperability with other Projects interested in this matter (EGEE’07 in Budapest, WLCG-WS in Taiwan, eScience 2007 in Bangalore)

  • A contact with OGF was started late September 2007, the participation at Interoperability Panel at upcoming Open Grid Forum events is planned

  • EU-IndiaGrid is ending in September 2008

  • A proposal is ready for EU-IndiaGrid2, describing a more detailed way on standards adoption/collaboration for job and data management interoperability


Thank you

Thank you


  • Login