roberto barbera and diego scardaci infn catania italy roberto barbera diego scardaci @ct infn it
Download
Skip this Video
Download Presentation
O utline

Loading in 2 Seconds...

play fullscreen
1 / 24

O utline - PowerPoint PPT Presentation


  • 157 Views
  • Uploaded on

A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed Worldwide Big Data, Big Network Workshop – 10 October 2013. Roberto Barbera and Diego Scardaci – INFN Catania - Italy { roberto.barbera , diego.scardaci } @ct.infn.it .

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'O utline' - varana


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
roberto barbera and diego scardaci infn catania italy roberto barbera diego scardaci @ct infn it
A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed WorldwideBig Data, Big Network Workshop – 10 October 2013

Roberto Barbera and Diego Scardaci– INFN Catania - Italy{roberto.barbera, diego.scardaci}@ct.infn.it

o utline
Introductoryconcepts and drivingconsiderations
  • Vision and use cases
  • Currentresults
  • Activities in Latin America
  • Summary and outlook
Outline

Big Data, Big Network Workshop - 10 October 2013

e volution of distributed computing
Cost of hw

Cost of networks

Evolution of distributed computing

Time

decrease

90’s-00’s

Grid

Computing

00’s-10’s

Cloud

Computing

80’s-90’s

Cluster

Computing

Mainframe

Computing

CPU power

WAN bandwidth

increase

research networks at global scale
Research Networks at “global” scale

Big Data, Big Network Workshop - 10 October 2013

the global grid
The “Global” Grid

Big Data, Big Network Workshop - 10 October 2013

the non global middleware
The “non-global” middleware

Genesis II

Interoperability and easiness of access are issues

Big Data, Big Network Workshop - 10 October 2013

cloud sky is not less cloudy
Cloud «sky» isnotless …«cloudy»

Big Data, Big Network Workshop - 10 October 2013

the chain reds project www chain project eu
The CHAIN-REDS Project(www.chain-project.eu)

Started: 1 Dec 2012

Duration: 30 months

Targetedregions: Africa,

Arab Region, Latin America,

China, India, and

Far-East Asia

interoperability and interoperation source wikipedia
According to ISO/IEC 2382-01 (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units“
  • In engineering, interoperation is the setup of ad hoc components and methods to make two or more systems work together as a combined system
Interoperability and interoperation(source: Wikipedia)

Adoption of standardsis key

Big Data, Big Network Workshop - 10 October 2013

v ision
A scientist can seamlessly run applications on HPC machines, Grids and Clouds based on different middleware
    • ( to demonstrate interoperability  use case #1)
  • The cloud tenantof a real or virtual organisation can seamlessly and easily manage Cloud resources pledged by providers owning infrastructures based on different Cloud middleware stacks
    • ( to demonstrate interoperation  use case #2 )
Vision

Big Data, Big Network Workshop - 10 October 2013

chain reds demo contributors
CHAIN-REDS Demo contributors

Big Data, Big Network Workshop - 10 October 2013

use case 1 scientist
Auser can sign in on a Science Gateway using his/her federated credentials, select an application from a menu and seamlessly execute it on HPC machines, Grids and Clouds
    • The fractions of executions on the three different platforms can be adjusted to simulate the need to “boost” the resources in case of temporary peaks of activity
Use case #1 (scientist)

Big Data, Big Network Workshop - 10 October 2013

a reference infrastructure the egi federated cloud
Web: http://www.egi.eu/infrastructure/cloud/

Wiki: https://wiki.egi.eu/wiki/Fedcloud-tf

A reference infrastructure: the EGI Federated Cloud

use case #1

use case #2

Big Data, Big Network Workshop - 10 October 2013

catania science gateway framework architecture
Administrator

Scientist

Cloud tenant

Embedded Services

.......

Catania Science Gateway Framework architecture

App.2

App.1

MyCloud

Catania Science Gateway

Use case #1

Use case #2

CLEVER Orchestrator (based on OCCI)

Grid/Cloud Engine (based on SAGA)

HPC

Clusters

Usersbelonging

to Identity Federations

Cloud #1

Cloud#2

Cloud#n

Single logical domain

official identity inter federations currently supported by catania science gateways
Official Identity (Inter-)Federations currently supported by Catania Science Gateways

VAMP Workshop 2013 – Helsinki, 30/9-1/10/2013

other idps deployed in latin america
Other IdPsdeployed in Latin America

Big Data, Big Network Workshop - 10 October 2013

the catania grid cloud engine
LiferayPortlets

Science

GW 1

Science

GW 3

Science

GW 2

The Catania Grid& Cloud Engine

Grid/Cloud

Engine

Science GW Interface

eToken

Server

UsersTrack &

Monit.

Users

Tracking

DB

Data Engine

Job Engine

SAGA/JSAGA API

Grid/Cloud/Local MWs

New

New

Updated

New

Updated

Updated

running applications on the egi federated cloud
Running applications on the EGI Federated Cloud

Big Data, Big Network Workshop - 10 October 2013

running applications on various types of e infrastructures
Running applications on various types of e-Infrastructures

Big Data, Big Network Workshop - 10 October 2013

science gateways in latin america the gisela science gateway http gisela gw ct infn it
Science Gateways in Latin America: the GISELA Science Gateway (http://gisela-gw.ct.infn.it)

Big Data, Big Network Workshop - 10 October 2013

el servicio de computaci n avanzada am rica latina y el caribe
As part of the SCALAC model, the GISELA SG has been re-installed and updated at UNAM (Mexico) and named SCALAC SG
  • The SCALAC SG is in progress to be relocated at: https://sgw.scalac.redclara.net
  • As part of the SCALAC commitments, CUDI (the Mexican NREN) is financing two pilot projects for new services: access to HPC and to Cloud infrastructures via the SCALAC Science Gateway
  • The SCALAC Science Gateway will be operational by the end of 2013
  • The SCALAC SG will be connected to the “Identity Provider of the Mexican Advanced Computing Services for e-Science” and to all other IdPsbeing established in Latin America in the context of the ELCIRA project
El Servicio de Computación Avanzada América Latina y el Caribe

https://comunidades.redclara.net/wiki/scalac/index.php/SCALAC

summary and outlook
Standard-basedinteroperabilityshould be enablednotonlyacrossmiddlewarebutalso and more importantlyacrosscomputingparadigms (Grid, HPC, Cloud, local clusters, desktops, etc.) in order to exploit big networks asmuchaspossible
  • Catania Science Gatewayssuccessfully bridge e-Infrastructuresdevelopedaccording to differentmodelsarchitectures and maketheminteroperableatuserapplicationlevelthanks to standard adoption (SAGA, SAML, OCCI, CDMI, JSR286, etc.)
  • The MyCloud service allowsseamless multi-cloud service operationacrossdifferent OCCI-compliantmiddlewarestacks on manysitesworldwide
  • Nextsteps are:
    • Creation of the sharedstorageinfrastructure to supportstatefulVMs
    • AllowdeployedVMs to «findthemselves» in MyCloud
    • Fostering the deployment of cloudinfrastructures in the regionsaddressed by CHAIN-REDS to widen the testbedboth in size and geographiccoverage
    • Promotion of the EGI FedCloud model and possibleextension of itsinfrastructure to otherregions in order to support global VRCs
Summary and outlook

Big Data, Big Network Workshop - 10 October 2013