1 / 38

Outline

gagan
Download Presentation

Outline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The agINFRA Science Gateway for the Agricultural Sciences’ Virtual Research CommunityG. Allegri1), G. Andronico2), R. Barbera2,3), F. Bitelli4), R. Bruno2,), A. Budano4), A. Calanducci2), F. Celli8), E. A .C. Costantini5), M. Fargetta2), A. Fornaia6), G. L’Abate5), S. Monforte2), A. Puliafito7), R. Ricceri2), F. Ruggieri4), D. Saitta2), M. Villari7) 1) GIS3W s.a.s., Viale G. Verdi, 24, 51016 Montecatini Terme – Italy2) INFN, Division of Catania, Via S. Sofia, 64, 95123 Catania – Italy3) Department of Physics and Astronomy of the University of Catania, Viale A. Doria, 6, 95125 Catania – Italy4) INFN, Division of Roma Tre, Via della Vasca Navale, 84, 00146 Rome – Italy5) Consiglio per la Ricerca e la Sperimentazione in Agricoltura, Centro di ricerca per l’agrobiologia e la pedologia (CRA-ABP), Piazza M. D'Azeglio, 30 - 50121 Florence - Italy6) Consortium GARR, Via dei Tizii, 6, 00185 Rome – Italy7) Faculty of Engineering of the University of Messina, Contrada Di Dio, 1, 98166 Messina – Italy8) Food and Agriculture Organisation of the United Nations, VialedelleTerme di Caracalla, 00153 Rome – Italy Corresponding author. Email: riccardo.bruno@ct.infn.it

  2. Outline • Project presentation • The Science Gateway Framework • Grid Engine, • Accessing remote services • Special portlets • Developing portlets • AgINFRA Science Gateway • Applications: The registry, Weka, and R • Services: ISIS • CLEVER and MyCloudportlet

  3. The agINFRA projectA data infrastructure to support agricultural scientific communities • agINFRAis an Integrated Infrastructure Initiative (I3) project that will try to introduce the agricultural scientific communities into the vision of open and participatory data-intensive science. • EU 7th Framework Programme • Data infrastructuresfore-Science • 3,75/4,8 M EUR financed • Started the15/10/2011 • Duration 36 Months • 20 Partners • UNIVERSIDAD DE ALCALA (UAH, Spain), FOOD AND AGRICULTURE ORGANIZATION OF THE UNITED NATIONS FAO (FAO, Italy), ISTITUTO NAZIONALE DI FISICA NUCLEARE (INFN, Italy), SALZBURG RESEARCH FORSCHUNGSGESELLSCHAFT M.B.H (SRFG, Austria), INSTITUT ZA FIZIKU (IPB, Serbia), MAGYAR TUDOMANYOS AKADEMIA SZAMITASTECHNIKAI ES AUTOMATIZALASI KUTATO INTEZET (SZTAKI, Hungary), PSOCHIOS IOANNIS & SIA OE - AGRO-KNOW TECHNOLOGIES (AK, Greece), 21C CONSULTANCY LIMITED (21C, UK), CENTRO DE TRANSFERENCIA DE TECNOLOGIAS ESCUELA SUPERIOR POLITECNICA DEL LITORAL (ESPOL, Equador), AGRICULTURAL INFORMATION INSTITUTE OF CHINESE ACADEMY OF AGRICULTURAL SCIENCES (ALL, China), THE OPEN UNIVERSITY (OU, UK), Indian Statistical Institute (ISI, India)

  4. Project aim and objectives • O1 - A data infrastructure to support agricultural infrastructure scientific communities • O2 - Promoting data sharing and development of trust in agricultural sciences • Harmonize and Orchestrate a huge amount of heterogeneous agricultural data through the adoption of DCIs (Grid, Cloud) • Access the information through simple interfaces and portals easily accessible to wide user communities

  5. Type E users Hi level portal developers Type F users nd user (researcher, educator) Type D users Data provider Information manager, Librarian, … WP6 High Level software Higher Level Portals (Organic, Agris, etc.) WP4 Middle level of infrastrucutre Type C users Data management Software developers Data management software systems, components, etc (AK,FAO,…) Catania Science Gateway SG Interfaces to applications Generic Science Gateway Type B users Processing Software developers Cloud Grid Infrastrucure level Type A users Infrastructure Providers CLEVER Okeanos EMI/gLite Other

  6. Catania SG Architecture Users having different roles and privileges 3 1 AAI Portlets(JSR 168/286) • Administrators • Power users • Basic users • VRC members • etc. 2 Catania Grid Engine (MW independent) Science Gateway JSAGA Web/Cloud Hosted Services Distributed Infrastructures

  7. AAI - Authorization and Authentication Infrastructure 1 • Identity Federation • Federates entity's identities to facilitate single sign-on or cross-domain single sign-on. • One or more services may be registered inside the federation (SP) • Identity Provider (IdP) • Manages identities and it is registered inside one or more Identify federation.It authorizes a user to access a service through tokens. Authentication SPs IdPs AutH/AutZ handled separately … Authorization SAML 2.0 … … Identity federations

  8. Catania Identity Federations andGrIDP + Social Netowork 1 https://gridp.garr.it • Supported Identity federations • GrIDP acts as catch-all Identity Federation • IDP ‘Social Bridge’ • Able to recognize identities from social networks through SimpleSAMLphp Grid IDentity Pool In progress

  9. AuthN Procedure 1 Sign-In Identity Federations’ discovery service «Open» Identity Provider http://idp.ct.infn.it

  10. Social AuthN procedure(GrIDP’ Social Network Bridge IdP) For more information watch www.youtube.com/watch?v=w6wfuGUwVVU 1 Identity Federations’ discovery service https://idpsocial.ct.infn.it

  11. Mobile AuthN 1 IdF and IdP selection Access to the resource

  12. Register and Sign In 1 Anonymous/Public Access Sign In Register Sign In - IdP Register to the IdP Not yet AuthZ Authorized Pages Not yet IdP member Portal AuthZ form Account AuthZ Granted IdP’ AuthNForm y/n? n y Account AuthZ Denied has to be authorized? Store Credentials (AuthZ)

  13. Catania Grid Engine eTokenServer (GSI Access) Science Gateway Portlets 2 Catania Grid Engine Science Gateway Interface Data Engine Job Engine Robot certificate Proxyes UserTracking Accounting Auditing JSAGA API Compliant with the EGI Portal and User Traceability policies e-Infrastructures

  14. Science Gateway Portletshttp://applications.epikh.eu/survey4sciencegateways ? New Application 3 New Application Grid Engine’ Science Gateway Interface Submit

  15. Adopted standards • The framework for Science Gateways developed at Catania is fully web-based and adopts official worldwide standards and protocols, through their most common implementations • The JSR 168 and JSR 286 standards (also known as "portlet 1.0" and "portlet 2.0" standards) • The OASISSecurity Assertion Markup Language (SAML) standard and its Shibboleth and SimpleSAMLphp implementations • The Lightweight Direct Access Protocol, and its OpenLDAP implementation • The Cryptographic Token Interface Standard (PKCS#11) standard and its Cryptoki implementation • The Open Grid Forum (OGF) Simple API for Grid Applications (SAGA) standard and its JSAGA implementation 2 1 1 3 3

  16. GILDA training e-Infrastructurehttps://gilda.ct.infn.it/ 3 • Training to access/use/develop distributed infrastructures • Provides everything any SG developer needs • Set of development Virtual Machines • A donwloadable VM for personal use • Wiki pages about: • Usage of GILDA’ Liferay Virtual Machine • Development of application portlets exploiting distributed infrastructures • Support in ‘porting’ existing software to distributed Infrastructures • Webinar / Web meetings • Training events for SG application developers

  17. SVN Software repositoryhttp://sourceforge.net/projects/ctsciencegtwys 3

  18. Portlet Template 3 • Public accessible code from from SVN (trunk/gilda) • mi-hostname-portlet (sequential execution on the Grid) • mpi-portlet (parallel execution on the Grid through MPI) • Stand-Alone code example available too • CLI based code that not requires a web portal to execute jobs; meant for early state developments or test on distributed infrastructures. • Code easily customizable • Just configure and execute a bash script ‘customize.sh’ • Then modify the interface JSP pages and Java code accordingly • Template just • Manages the Job Input interface • Provide the necessary data to the GridEngine to submit and control the job

  19. Developer’s requirements 3 • Average knowledge of Java language • Basic knowledge of code buiding and execution on Linux OS • Basic knowledge of web coding (eg.:HTML, JSP, etc.) • Distributed infrastructures main concepts

  20. Portal Applications ? Application User Interface Application space Run page Appears only in case the user has not logged in yet Application Description

  21. Special portlets: My Workspace User Jobs User Job Map User’ Data Help

  22. Special portlets: MyJobs

  23. Special portlets: Portal Application Registry

  24. agINFRAScience Gatewayhttps://aginfra-sg.ct.infn.it • Same Look and Feel of the main web-site. • Content easily editable by the system administrators • Links to the most popular social networks • 5 Applications available: • AGRIS AP XML2RDF Converter • ISIS Italian Soil Information System • RiceInfo • Agrovoc Tagging • Weka • R • 3 Services • AGLRTool • MapInfo • imf-SRFG

  25. Installed SG Applications examples 1/2 • Weka(Documentation Research and Training Centre) Indian Statistical Institute • WEKA consists of various machine learning algorithms that can be applied to Data Mining problems User can specify one or more algorithms to execute over the given input file Output of processed algorithms

  26. Installed SG Applications examples 2/2 • R • Well known statistical data analisys tool in sciences

  27. agINFRA Science Gateway Services • Accessing services form the SG • Soil Maps • ISIS (WebGIS application to map Italian Soil Information) • AGLR Tool • Imf-SRFG • The ISIS 1st experience • Direct access forbidden • Two access modes • Public accss with a limitedset of features • Private access with full capabilities • The service benefits of • VRC Access through IdF/IdP • Possibility to provide differentuser accessibility throughportal authZ rules • Export the model to Clouds(See presenation of MyCloud)

  28. Soil Maps Browser/Annotator Browse gLibrary metadata content • Exportable in OAI-PMH fmt. • Available verbs: • Identify • ListRecords Allow to modify/add to gLibrary metadata content

  29. ISIS Italian Soil Information System 1/2 Public/Anonymous access WebGIS

  30. ISIS Italian Soil Information System 2/2 Access to restricted portal areas WebGIS

  31. CLEVER: a Virtual Infrastructure Manager • CLEVER: A CLoud-Enabled Virtual EnviRonment • Developed by Univ. of Messina in collaboration with INFN Catania: • Simplifies the access and management of private/hybridclouds • Providessimple and easilyaccessibleinterfaces to interact with different “interconnected” clouds, deploying Virtual Machines and performingloadbalancingthroughmigration

  32. MyClouddemo video at: http://www.scivee.tv/node/57847 • Science Gateway portlet to manage Cloud Nodes and Virtual Machine instances • Easy management of VM Images • Single or Multiple instances (public/NAT IP address) • VNC Access to the VMs • Start/Stop instances • Get VM info • Undeploy VM from the Node • Complete usage help • User must be Signed-Inand authorized asCloud Manager

  33. On demand registered services 1 2 • ‘Cloud services’ hosts the links to all virtualized services • AGLR Tool • Imf-SRFG (soon included in the list) • User must be Signed-In and authorized to access this page

  34. Deploy AgLR Tool (MyCloud) • MyCloudallows intuitive access to and management of the resources on the INFN Catania cloudpowered by CLEVER • CloudManagers can deployservices on the cloud by simplydraggingthem on availablenodes

  35. On demand registered services 1 2 • ‘Cloud services’ hosts the links to all virtualized services • AGLR Tool • Imf-SRFG (soon included in the list) • User must be Signed-In and authorized to access this page

  36. MyCloud new Features • Some additional interface feature such as • Automatic VM Deploy; just dragging it (actually managed manually) • Node to Node VM migration • VM Snapshooting management • Safe VM undeployment • A Cloud node that bridges via OCCI to other Clouds

  37. Conclusions • Adoption of standards a key point for the sustainability of agINFRA portal • The portal ease the access to the underlying DCIs with compliance to the EGI portal traceability policy • Portlets and Cloud services may be easily integrated and managed

  38. Questions ?

More Related