Roberto barbera and diego scardaci infn catania italy roberto barbera diego scardaci @ct infn it
Download
1 / 24

O utline - PowerPoint PPT Presentation


  • 153 Views
  • Uploaded on
  • Presentation posted in: General

A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed Worldwide Big Data, Big Network Workshop – 10 October 2013. Roberto Barbera and Diego Scardaci – INFN Catania - Italy { roberto.barbera , diego.scardaci } @ct.infn.it .

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha

Download Presentation

O utline

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Roberto barbera and diego scardaci infn catania italy roberto barbera diego scardaci @ct infn it

A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed WorldwideBig Data, Big Network Workshop – 10 October 2013

Roberto Barbera and Diego Scardaci– INFN Catania - Italy{roberto.barbera, diego.scardaci}@ct.infn.it


O utline

  • Introductory Access HPC, Grid and Cloud Resources Distributed Worldwideconcepts and drivingconsiderations

  • Vision and use cases

  • Currentresults

  • Activities in Latin America

  • Summary and outlook

Outline

Big Data, Big Network Workshop - 10 October 2013


E volution of distributed computing

Cost Access HPC, Grid and Cloud Resources Distributed Worldwide of hw

Cost of networks

Evolution of distributed computing

Time

decrease

90’s-00’s

Grid

Computing

00’s-10’s

Cloud

Computing

80’s-90’s

Cluster

Computing

Mainframe

Computing

CPU power

WAN bandwidth

increase


Research networks at global scale
Research Networks at “global” scale Access HPC, Grid and Cloud Resources Distributed Worldwide

Big Data, Big Network Workshop - 10 October 2013


The global grid
The Access HPC, Grid and Cloud Resources Distributed Worldwide“Global” Grid

Big Data, Big Network Workshop - 10 October 2013


The non global middleware
The “non-global Access HPC, Grid and Cloud Resources Distributed Worldwide” middleware

Genesis II

Interoperability and easiness of access are issues

Big Data, Big Network Workshop - 10 October 2013


Cloud sky is not less cloudy
Cloud Access HPC, Grid and Cloud Resources Distributed Worldwide «sky» isnotless …«cloudy»

Big Data, Big Network Workshop - 10 October 2013


The chain reds project www chain project eu
The Access HPC, Grid and Cloud Resources Distributed WorldwideCHAIN-REDS Project(www.chain-project.eu)

Started: 1 Dec 2012

Duration: 30 months

Targetedregions: Africa,

Arab Region, Latin America,

China, India, and

Far-East Asia


Interoperability and interoperation source wikipedia

  • According Access HPC, Grid and Cloud Resources Distributed Worldwideto ISO/IEC 2382-01 (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units“

  • In engineering, interoperation is the setup of ad hoc components and methods to make two or more systems work together as a combined system

Interoperability and interoperation(source: Wikipedia)

Adoption of standardsis key

Big Data, Big Network Workshop - 10 October 2013


V ision

  • A Access HPC, Grid and Cloud Resources Distributed Worldwidescientist can seamlessly run applications on HPC machines, Grids and Clouds based on different middleware

    • ( to demonstrate interoperability  use case #1)

  • The cloud tenantof a real or virtual organisation can seamlessly and easily manage Cloud resources pledged by providers owning infrastructures based on different Cloud middleware stacks

    • ( to demonstrate interoperation  use case #2 )

Vision

Big Data, Big Network Workshop - 10 October 2013


Chain reds demo contributors
CHAIN-REDS Demo contributors Access HPC, Grid and Cloud Resources Distributed Worldwide

Big Data, Big Network Workshop - 10 October 2013


Use case 1 scientist

  • A Access HPC, Grid and Cloud Resources Distributed Worldwideuser can sign in on a Science Gateway using his/her federated credentials, select an application from a menu and seamlessly execute it on HPC machines, Grids and Clouds

    • The fractions of executions on the three different platforms can be adjusted to simulate the need to “boost” the resources in case of temporary peaks of activity

Use case #1 (scientist)

Big Data, Big Network Workshop - 10 October 2013


A reference infrastructure the egi federated cloud

Web Access HPC, Grid and Cloud Resources Distributed Worldwide: http://www.egi.eu/infrastructure/cloud/

Wiki: https://wiki.egi.eu/wiki/Fedcloud-tf

A reference infrastructure: the EGI Federated Cloud

use case #1

use case #2

Big Data, Big Network Workshop - 10 October 2013


Catania science gateway framework architecture

Administrator Access HPC, Grid and Cloud Resources Distributed Worldwide

Scientist

Cloud tenant

Embedded Services

.......

Catania Science Gateway Framework architecture

App.2

App.1

MyCloud

Catania Science Gateway

Use case #1

Use case #2

CLEVER Orchestrator (based on OCCI)

Grid/Cloud Engine (based on SAGA)

HPC

Clusters

Usersbelonging

to Identity Federations

Cloud #1

Cloud#2

Cloud#n

Single logical domain


Official identity inter federations currently supported by catania science gateways
Official Identity Access HPC, Grid and Cloud Resources Distributed Worldwide(Inter-)Federations currently supported by Catania Science Gateways

VAMP Workshop 2013 – Helsinki, 30/9-1/10/2013


Other idps deployed in latin america
Other Access HPC, Grid and Cloud Resources Distributed WorldwideIdPsdeployed in Latin America

Big Data, Big Network Workshop - 10 October 2013


The catania grid cloud engine

Liferay Access HPC, Grid and Cloud Resources Distributed WorldwidePortlets

Science

GW 1

Science

GW 3

Science

GW 2

The Catania Grid& Cloud Engine

Grid/Cloud

Engine

Science GW Interface

eToken

Server

UsersTrack &

Monit.

Users

Tracking

DB

Data Engine

Job Engine

SAGA/JSAGA API

Grid/Cloud/Local MWs

New

New

Updated

New

Updated

Updated


Running applications on the egi federated cloud
Running applications on the EGI Federated Cloud Access HPC, Grid and Cloud Resources Distributed Worldwide

Big Data, Big Network Workshop - 10 October 2013


Running applications on the egi federated cloud1
Running applications on the EGI Federated Cloud Access HPC, Grid and Cloud Resources Distributed Worldwide


Running applications on various types of e infrastructures
Running applications on various types of e-Infrastructures Access HPC, Grid and Cloud Resources Distributed Worldwide

Big Data, Big Network Workshop - 10 October 2013


Science gateways in latin america the gisela science gateway http gisela gw ct infn it
Science Gateways in Latin America: Access HPC, Grid and Cloud Resources Distributed Worldwidethe GISELA Science Gateway (http://gisela-gw.ct.infn.it)

Big Data, Big Network Workshop - 10 October 2013


El servicio de computaci n avanzada am rica latina y el caribe

  • As part of Access HPC, Grid and Cloud Resources Distributed Worldwidethe SCALAC model, the GISELA SG has been re-installed and updated at UNAM (Mexico) and named SCALAC SG

  • The SCALAC SG is in progress to be relocated at: https://sgw.scalac.redclara.net

  • As part of the SCALAC commitments, CUDI (the Mexican NREN) is financing two pilot projects for new services: access to HPC and to Cloud infrastructures via the SCALAC Science Gateway

  • The SCALAC Science Gateway will be operational by the end of 2013

  • The SCALAC SG will be connected to the “Identity Provider of the Mexican Advanced Computing Services for e-Science” and to all other IdPsbeing established in Latin America in the context of the ELCIRA project

El Servicio de Computación Avanzada América Latina y el Caribe

https://comunidades.redclara.net/wiki/scalac/index.php/SCALAC


Summary and outlook

  • Standard- Access HPC, Grid and Cloud Resources Distributed Worldwidebasedinteroperabilityshould be enablednotonlyacrossmiddlewarebutalso and more importantlyacrosscomputingparadigms (Grid, HPC, Cloud, local clusters, desktops, etc.) in order to exploit big networks asmuchaspossible

  • Catania Science Gatewayssuccessfully bridge e-Infrastructuresdevelopedaccording to differentmodelsarchitectures and maketheminteroperableatuserapplicationlevelthanks to standard adoption (SAGA, SAML, OCCI, CDMI, JSR286, etc.)

  • The MyCloud service allowsseamless multi-cloud service operationacrossdifferent OCCI-compliantmiddlewarestacks on manysitesworldwide

  • Nextsteps are:

    • Creation of the sharedstorageinfrastructure to supportstatefulVMs

    • AllowdeployedVMs to «findthemselves» in MyCloud

    • Fostering the deployment of cloudinfrastructures in the regionsaddressed by CHAIN-REDS to widen the testbedboth in size and geographiccoverage

    • Promotion of the EGI FedCloud model and possibleextension of itsinfrastructure to otherregions in order to support global VRCs

Summary and outlook

Big Data, Big Network Workshop - 10 October 2013


Questions
Questions ? Access HPC, Grid and Cloud Resources Distributed Worldwide


  • Login