Roberto barbera and diego scardaci infn catania italy roberto barbera diego scardaci @ct infn it
This presentation is the property of its rightful owner.
Sponsored Links
1 / 24

O utline PowerPoint PPT Presentation


  • 125 Views
  • Uploaded on
  • Presentation posted in: General

A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed Worldwide Big Data, Big Network Workshop – 10 October 2013. Roberto Barbera and Diego Scardaci – INFN Catania - Italy { roberto.barbera , diego.scardaci } @ct.infn.it .

Download Presentation

O utline

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Roberto barbera and diego scardaci infn catania italy roberto barbera diego scardaci @ct infn it

A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed WorldwideBig Data, Big Network Workshop – 10 October 2013

Roberto Barbera and Diego Scardaci– INFN Catania - Italy{roberto.barbera, [email protected]


O utline

  • Introductoryconcepts and drivingconsiderations

  • Vision and use cases

  • Currentresults

  • Activities in Latin America

  • Summary and outlook

Outline

Big Data, Big Network Workshop - 10 October 2013


E volution of distributed computing

Cost of hw

Cost of networks

Evolution of distributed computing

Time

decrease

90’s-00’s

Grid

Computing

00’s-10’s

Cloud

Computing

80’s-90’s

Cluster

Computing

Mainframe

Computing

CPU power

WAN bandwidth

increase


Research networks at global scale

Research Networks at “global” scale

Big Data, Big Network Workshop - 10 October 2013


The global grid

The “Global” Grid

Big Data, Big Network Workshop - 10 October 2013


The non global middleware

The “non-global” middleware

Genesis II

Interoperability and easiness of access are issues

Big Data, Big Network Workshop - 10 October 2013


Cloud sky is not less cloudy

Cloud «sky» isnotless …«cloudy»

Big Data, Big Network Workshop - 10 October 2013


The chain reds project www chain project eu

The CHAIN-REDS Project(www.chain-project.eu)

Started: 1 Dec 2012

Duration: 30 months

Targetedregions: Africa,

Arab Region, Latin America,

China, India, and

Far-East Asia


Interoperability and interoperation source wikipedia

  • According to ISO/IEC 2382-01 (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units“

  • In engineering, interoperation is the setup of ad hoc components and methods to make two or more systems work together as a combined system

Interoperability and interoperation(source: Wikipedia)

Adoption of standardsis key

Big Data, Big Network Workshop - 10 October 2013


V ision

  • A scientist can seamlessly run applications on HPC machines, Grids and Clouds based on different middleware

    • ( to demonstrate interoperability  use case #1)

  • The cloud tenantof a real or virtual organisation can seamlessly and easily manage Cloud resources pledged by providers owning infrastructures based on different Cloud middleware stacks

    • ( to demonstrate interoperation  use case #2 )

Vision

Big Data, Big Network Workshop - 10 October 2013


Chain reds demo contributors

CHAIN-REDS Demo contributors

Big Data, Big Network Workshop - 10 October 2013


Use case 1 scientist

  • Auser can sign in on a Science Gateway using his/her federated credentials, select an application from a menu and seamlessly execute it on HPC machines, Grids and Clouds

    • The fractions of executions on the three different platforms can be adjusted to simulate the need to “boost” the resources in case of temporary peaks of activity

Use case #1 (scientist)

Big Data, Big Network Workshop - 10 October 2013


A reference infrastructure the egi federated cloud

Web: http://www.egi.eu/infrastructure/cloud/

Wiki: https://wiki.egi.eu/wiki/Fedcloud-tf

A reference infrastructure: the EGI Federated Cloud

use case #1

use case #2

Big Data, Big Network Workshop - 10 October 2013


Catania science gateway framework architecture

Administrator

Scientist

Cloud tenant

Embedded Services

.......

Catania Science Gateway Framework architecture

App.2

App.1

MyCloud

Catania Science Gateway

Use case #1

Use case #2

CLEVER Orchestrator (based on OCCI)

Grid/Cloud Engine (based on SAGA)

HPC

Clusters

Usersbelonging

to Identity Federations

Cloud #1

Cloud#2

Cloud#n

Single logical domain


Official identity inter federations currently supported by catania science gateways

Official Identity (Inter-)Federations currently supported by Catania Science Gateways

VAMP Workshop 2013 – Helsinki, 30/9-1/10/2013


Other idps deployed in latin america

Other IdPsdeployed in Latin America

Big Data, Big Network Workshop - 10 October 2013


The catania grid cloud engine

LiferayPortlets

Science

GW 1

Science

GW 3

Science

GW 2

The Catania Grid& Cloud Engine

Grid/Cloud

Engine

Science GW Interface

eToken

Server

UsersTrack &

Monit.

Users

Tracking

DB

Data Engine

Job Engine

SAGA/JSAGA API

Grid/Cloud/Local MWs

New

New

Updated

New

Updated

Updated


Running applications on the egi federated cloud

Running applications on the EGI Federated Cloud

Big Data, Big Network Workshop - 10 October 2013


Running applications on the egi federated cloud1

Running applications on the EGI Federated Cloud


Running applications on various types of e infrastructures

Running applications on various types of e-Infrastructures

Big Data, Big Network Workshop - 10 October 2013


Science gateways in latin america the gisela science gateway http gisela gw ct infn it

Science Gateways in Latin America: the GISELA Science Gateway (http://gisela-gw.ct.infn.it)

Big Data, Big Network Workshop - 10 October 2013


El servicio de computaci n avanzada am rica latina y el caribe

  • As part of the SCALAC model, the GISELA SG has been re-installed and updated at UNAM (Mexico) and named SCALAC SG

  • The SCALAC SG is in progress to be relocated at: https://sgw.scalac.redclara.net

  • As part of the SCALAC commitments, CUDI (the Mexican NREN) is financing two pilot projects for new services: access to HPC and to Cloud infrastructures via the SCALAC Science Gateway

  • The SCALAC Science Gateway will be operational by the end of 2013

  • The SCALAC SG will be connected to the “Identity Provider of the Mexican Advanced Computing Services for e-Science” and to all other IdPsbeing established in Latin America in the context of the ELCIRA project

El Servicio de Computación Avanzada América Latina y el Caribe

https://comunidades.redclara.net/wiki/scalac/index.php/SCALAC


Summary and outlook

  • Standard-basedinteroperabilityshould be enablednotonlyacrossmiddlewarebutalso and more importantlyacrosscomputingparadigms (Grid, HPC, Cloud, local clusters, desktops, etc.) in order to exploit big networks asmuchaspossible

  • Catania Science Gatewayssuccessfully bridge e-Infrastructuresdevelopedaccording to differentmodelsarchitectures and maketheminteroperableatuserapplicationlevelthanks to standard adoption (SAGA, SAML, OCCI, CDMI, JSR286, etc.)

  • The MyCloud service allowsseamless multi-cloud service operationacrossdifferent OCCI-compliantmiddlewarestacks on manysitesworldwide

  • Nextsteps are:

    • Creation of the sharedstorageinfrastructure to supportstatefulVMs

    • AllowdeployedVMs to «findthemselves» in MyCloud

    • Fostering the deployment of cloudinfrastructures in the regionsaddressed by CHAIN-REDS to widen the testbedboth in size and geographiccoverage

    • Promotion of the EGI FedCloud model and possibleextension of itsinfrastructure to otherregions in order to support global VRCs

Summary and outlook

Big Data, Big Network Workshop - 10 October 2013


Questions

Questions ?


  • Login