1 / 30

PL-Grid : National Grid Initiative in Poland Structure and Status

PL-Grid : National Grid Initiative in Poland Structure and Status. BigView. Jacek Kitowski Institute of Computer Science AGH-UST ACK CYFRONET AGH in collaboration with PL-Grid Representatives. HP-CAST Madrid, May 10-13, 2009. Outline. PL-Grid Consortium

verena
Download Presentation

PL-Grid : National Grid Initiative in Poland Structure and Status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PL-Grid:National GridInitiativein PolandStructure and Status BigView Jacek Kitowski Institute of Computer Science AGH-USTACK CYFRONET AGH incollaborationwithPL-GridRepresentatives HP-CAST Madrid, May 10-13, 2009

  2. Outline • PL-GridConsortium • SystematicapproachestablishingtheConsortium and NGI • Motivation • Rationales • Foundations • International Collaboration • PL-Grid Project in a nutshell • Status • PL-Grid Project • Infrastructure • Workpackages • Summary

  3. Motivation • E-Science approach to research • Integration activities ongoing in the world

  4. Need for e-Science Approach • E-Science: collaborative research supported by advanced distributed computations • Multi-disciplinary, Multi-Site and Multi-National • Building with and demanding advances in Computing/Computer Sciences • Goal: to enable better research in all disciplines • System-level Science: beyond individual phenomena, components interact and interrelate • to generate, interpretand analyse rich data resources • From experiments, observations and simulations • Quality management, preservation and reliable evidence • to develop and explore models and simulations • Computation and data at all scales • Trustworthy, economic, timely and relevant results • to enable dynamic distributed collaboration • Facilitating collaboration with information and resource sharing • Security, trust, reliability, accountability, manageability and agility I. Foster, System Level Science and System Level Models, Snowmass, August 1-2, 2007 M. Atkinson, e-Science (...), Grid2006 & 2-nd Int.Conf.e-Social Science 2006, National e-Science Centre UK

  5. GEANT2 RationalesbehindPL-GridConsortium • Thanks to CYFRONET activity five High Performance Computing Polish Centres analysed according to: • Participation in International and National Projects and Collaboration • Need by Polish Scientific Communities • Computational resources to date • European/Worldwide integration Activities • National Network Infrastructure ready (thanks to Pionier National Project)

  6. ParticipationinProjects and Collaboration • ~35 international projects FP5, FP6, FP7 on Grids (50% common) • Grid Projects: Crossgrid, Gridstart, Unicore, EGEE I,II,III, K-WfGrid, Coregrid, Virolab, Gredia, int.eu.grid, Eurogrid, Grip, Unigrids, Balticgrid I,II, Gridlab, Intelligrid, Ringrid, Brein, Beingrid, Qoscosgrid, Chemomentum, EUChinagrid, PRACE,… • ~10 Polish projects (50% common) • Pionier, Progress, SGIgrid, Clusterix, NDS, Platon, IT-SOA, …. • Close collaboration with Institute of Computer Science AGH-UST

  7. Need by Polish Scientific Communities Distribution of Polish publications in period 01.2004 – 04.2008 according to Science Citation Index Expanded + Social Science Citation Index + Arts & Humanities Citation Index

  8. Partners’ Resources to Date TOP500 – Nov.2008 PolishSites

  9. National European e-Infrastructure International Routine Usage 2000 Testbeds 2010 Utility Service National and International IntegrationInitiatives Ongoing European and Worldwide activities and consolidation • EGEE • EGI_DS, EGI • DEISA • PRACE • ...... SGI Grid, Progress (Clusterix, National Data Store ...) Chemomomentum, Virolab, CoreGrid, Gredia, int.eu.grid, Baltic Grid, GridLab, Porta Optica, RINGRid, Phosphorus, QoSCoSGrid, Intelligrid, K-WfGrid, Unicore...

  10. OtherActivities – Collaboration and Dissemination • EGI_DS – CYFRONET activity • Policy Board (deputy: M. Turala), • NGI Observers -- „PolishExperts” (WP3, WP5) participationinWorkshops, resultedinEGI_DS draft deliverables, use-cases ... • EGEE • FromCyfronet: chairing Resource Allocation Group in EGEE-III – trying to influence EGI • Group has a mandate to manage current process of resource allocation in EGEE and propose better model for future • Operate CE ROC • More: https://twiki.cern.ch/twiki/bin/view/EGEE/RAG • E-IRG – CYFRONET activity • Workshops • Discussions on EGEE – EGI – NGI future • EU Unit F3 „ResearchInfrastructure” Expertsin Program Committee, nominated by thePolishMinistry of Science and High Education(since 2007) from CYFRONET • ENPG seminarinCracow (2008) • Others • CGW 2007 and 2008 • CyfronetUsers’ AnnualConference (2008 and 2009) • CyfronetOpen Day (2007, 2008) • ICCS 2008 Conference

  11. Other Activities • Computational Chemistry (VO) in EGEE • Third CPU power consumer • Nearly 3 million of jobs executed during 2007 • Lead by Cyfronet since 2006 • Recently management of Computational Chemistry Cluster of Excellence • In parallel current effort include: • Grid ports of commercial and non commercial software packages with particular focus on their parallel version • Development of “experiment centric” grid web portal for chemists • EGEE III / CE ROC

  12. EGEE-III / CE ROC • CE ROC – coordinator: ACK CYFRONET-AGH • Consortiumconsists of institutesfrom 7 countries:Austria (2), Croatia (3), Czech (1), Hungary (5), Poland (4), Slovakia (1), Slovenia (1) • Operate, maintain and support EGEE GridInfrastructurein CE region • VirtualOrganizationssupportedin Central European region:HEP, computationalchemistry, biomedicine, pharmacology, astrophysics, earth scienceand regionalusers (VOCE VO) Warsaw-ICM Cracow-CYFRONET Published by sites Poznan-PSNC cores storage

  13. Motivation E-Science approach to research EGI initiative ongoing in collaboration with NGIs Creation of Polish Grid (PL-Grid) Consortium: http://plgrid.pl Consortium Agreement signed in January 2007 PL-Grid Project (2009-2012) Application in Operational Programme Innovative Economy, Activity 2.3 (in Sept. 2008) Get funded March 2, 2009 (via European Structural Funds) Consortium made up of five largest Polish supercomputing and networking centres (founders) ACK CYFRONET AGH (Cracow) – Coordinator PL-GridFoundations – Summary Polish Infrastructure for Supporting Computational Science in the European Research Space Response to the needs of Polish scientists and ongoing Grid activities in Poland, other European countries and all over the world

  14. GEANT2 PL-Grid Consortium Founders • Academic Computer Center Cyfronet AGH (ACK CYFRONET AGH) Coordinator • Poznań Supercomputing and Networking Center (PCSS) • Wrocław Centre for Networking and Supercomputing (WCSS) • Academic Computer Center in Gdańsk (TASK) • Interdisciplinary Center for Math. and Computat. Modelling, • Warsaw University (ICM)

  15. Users AdvancedServicePlatforms Grid Application Programming Interface Grid portals, development tools Application Application Application Application Virtual organizations and security systems DomainGrid DomainGrid DomainGrid DomainGrid Other Grids systems Grid services UNICORE (DEISA) LCG/gLite (EGEE) Basic Grid services Gridinfrastructure (Grid services) PL-Grid Clusters High Performance Computers Data repositories Distributed computational resources Distributed data repositories National computer network Grid resources National Computer Network PIONIER PL-GridInfrastructure • Assumptions • Polish Grid isgoingto have a common base infrastructure– similar to solutions adopted in other countries. • Specialized, domain Grid systems – including services and tools focused on specific types of applications – will be built upon this infrastructure. • These domain Grid systems can be further developed and maintained in the framework of separate projects. • Such an approach should enable efficient use of available financial resources. • Creation of a Grid infrastructure fully compatible and interoperable with European and World Grids thanks to cooperation with teams involved in the development of European Grid systems (EGEE, DEISA, OMII, C-OMEGA, ESFRI). • Plans for HPC and ScalabilityComputingenabled.

  16. PROJECT MANAGEMENT P1 P2 PLANNING AND DEVELOPMENT OF INFRASTRUCTURE Coordination StructureOperation Rules Dissemination P3 OPERATIONS CENTER P6 P4 SECURITY CENTER GRID SOFTWARE AND USERS TOOLS DEVELOPMENT … . EGEE DEISA P5 SUPPORT FOR VARIOUS DOMAIN GRIDS Training Planned Realization of Aims The PL-Grid Project is split into several workpackages • Main Project Indicators: • PeakPerf.: 215 Tflops • DiskStorage: 2500 TB

  17. Challenges • Short term • To start – establishing PL-Grid VO using Partners’ local and EGEE resources • To provide resources for covering operational costs • To select computational/storage resources for PL-Grid infrastructure • Long term – continously • To provide the necessary infrastructure (!!) • Computer rooms, electrical power, many organizational issues • Be prepared / work on approaching paradigms and integration development • HPC – Scalable Computing • Clouds (internal-external, computing clouds, data clouds) • SOA paradigm, knowledge usage …

  18. Thank you

  19. PL-Grid:National GridInitiativein PolandStructure and Status TechnicalIssues Jacek Kitowski Institute of Computer Science AGH-USTACK CYFRONET AGH incollaborationwithPL-GridRepresentatives HP-CAST Madrid, May 10-13, 2009

  20. AdvancedServicePlatforms Application Application Application Application DomainGrid DomainGrid DomainGrid DomainGrid Grid infrastructure (Grid services) PL-Grid Clusters High Performance Computers Data repositories National Computer Network PIONIER PL-GridInfrastructure • Assumptions • Polish Grid isgoingto have a common base infrastructure– similar to solutions adopted in other countries. • Specialized, domain Grid systems – including services and tools focused on specific types of applications – will be built upon this infrastructure. • These domain Grid systems can be further developed and maintained in the framework of separate projects. • Such an approach should enable efficient use of available financial resources. • Creation of a Grid infrastructure fully compatible and interoperable with European and World Grids thanks to cooperation with teams involved in the development of European Grid systems (EGEE, DEISA, OMII, C-OMEGA, ESFRI). • Plans for HPC and ScalabilityComputingenabled.

  21. Users Grid Application Programming Interface Grid portals, development tools Virtual organizations and security systems Other Grids systems Grid services UNICORE (DEISA) LCG/gLite (EGEE) Basic Grid services Distributed computational resources Distributed data repositories National computer network Grid resources Elements and Functionality • PL-Grid software will comprise: • user tools (portals, systems for applications management and monitoring, result visualization and other purposes, compatible with the lower-layer software used in PL-Grid); • software libraries; • virtual organization systems: certificates, accounting, security, dynamic ; • data management systems: metadata catalogues, replica management, file transfer; • resource management systems: job management, applications, grid services and infrastructure monitoring, license management, local resource management, monitoring. • Three Grid structures will be maintained: • production, • reseach, • testing.

  22. PROJECT MANAGEMENT P1 P2 PLANNING AND DEVELOPMENT OF INFRASTRUCTURE Coordination StructureOperation Rules Dissemination P3 OPERATIONS CENTER P6 P4 SECURITY CENTER GRID SOFTWARE AND USERS TOOLS DEVELOPMENT … . EGEE DEISA P5 SUPPORT FOR VARIOUS DOMAIN GRIDS Training Planned Realization of Aims The PL-Grid Project is split into several workpackages • Main Project Indicators: • PeakPerf.: 215 Tflops • DiskStorage: 2500 TB

  23. WP2: Planning of Infrastructure Development • Analysis of users’ requirement • Analysis of worldwide activity in infrastructure development • Expecting results: • Current activity: organization of pilot PL-Grid VO using EGEE infrastructure • From analysis: clusters with x86 processors

  24. WP3: Operations Center’s tasks • Coordination of Operation • Management and accounting • EGI and DEISA collaboration(HPC and ScalabilityComputing) • Users’ requirements • More spectacular (usingresearchand test infrastructures) • Computational Cloud • Data Cloud • Internal and ExternalClouds EGI Group EGI Production Middleware EGI TestingMiddleware

  25. WP4: Grid Software and UsersTools • Workpackage on Development/Research • Analysis of users’ requirements • Software repository (different tools and components developed by Partners) • Reengineering of tools and applications (legacy codes, APIs, SOA applications) • Virtual Laboratory (component applications, workflows, applications monitoring) – from EU FP6 Virolab Project • High-level virtual organizations using knowledge (semi-automatic creation using contract, semantic description of resources, monitoring of SLA due to QoS), data access – FiVO from EU FP6 Gredia Project • Tools for management, proactive monitoring and security (Bazaar, Permis)

  26. WP5: Support and Training • Users’ support • Making commercial software available for the users (license activity) • Training, education

  27. WP6: Security • Users’ support • Authorization, authentication, ... • Certificates ...

  28. t.szepieniec@cyfronet.pl GAUSSIAN in Grid • Gaussian VOcreatedsupported by several Partners (EGEE activity) • Accepted by Vendor • Registration:https://voms.cyf-kr.edu.pl:8443/vo/gaussian/vomrs • VO Manager: Mariusz Sterzel (CYFRONET), EGEE II Comput. Chemistry coordinator m.sterzel@cyfronet.pl ACK: Tomasz Szepieniec

  29. Never Born Protein Folding t.szepieniec@cyfronet.pl ACK: Irena Roterman, Jagiellonian University, Tomasz Szepieniec

  30. Activities • Short term • To start – establishing PL-Grid VO using Partners’ local and EGEE resources • To provide resources for covering operational costs • To select computational/storage resources for PL-Grid infrastructure • Long term – continously • To provide the necessary infrastructure (!!) • Computer rooms, electrical power, many organizational issues • Towards Cloud Computing (internal, external) • Towards HPCaaS and Scalable computing

More Related