MD-GRID NGI. International and regional projects for Grid technologies development

1. MD-GRID NGI. International and regional projects for Grid technologies development Dr. Petru Bogatencov,RENAM The SEE-GRID initiative is co-funded by the European Commission under the FP6 and FP7 Research Infrastructures

2. Outline • SEE-GRID-1 project May 2004 - May 2006: results • SEE-GRID-2 project May 2006 - May 2008: • Objectives • Results • SEE-GRID-SCI • Objectives • Recommendations for regional initiatives SEE-GRID: Advancing South-East Europe into the eInfrastructure era 2

3. The SEE-GRID initiative Contribute to building a worldwide Infrastructure by expanding the “eInfrastructure inclusion” into South-East Europe SEEREN SEEREN > http://www.see-grid.eu SEE-GRID: Advancing South-East Europe into the eInfrastructure era 3

4. Grids: regional expansion 2004-2009 EGEE BalticGrid peer cooperations EUMEDGRID, EXPRESS EELA, RedCLARA SEE-GRID EUChinaGrid SEE-GRID: Advancing South-East Europe into the eInfrastructure era 4

5. EGEE project EGEE-II aims to build on the work of the EGEE project, which was conceivedas the first two-year phase of a four-year programme, to provide a productionquality Grid infrastructure across the European Research Area and beyond. Researchers in academia and industry already benefit from the EGEE e-Infrastructure, which simultaneously supports many applications from diversescientific areas, providing a common pool of resources, independent ofgeographic location, with round-the-clock access to major storage, computeand networking facilities. The EGEE-II project will significantly extend and consolidate thisinfrastructure, which links national, regional and thematic Grid efforts, as wellas interoperate with other Grids around the globe. The resulting high capacity,world-wide infrastructure greatly surpasses the capabilities of local clustersand individual centres, providing a unique tool for collaborative computeintensive science (“e-Science”). SEE-GRID: Advancing South-East Europe into the eInfrastructure era 5

6. EGEE project • The EGEE Grid is built on the EU Research Network GÉANT and exploit Grid expertise generated by many EU, national and international Grid projects to date. • Funded by the European Commission, the EGEE project community has been divided into 12 partner federations, consisting of over 90 contractors and over 30 non-contacting participants covering almost all Europe SEE-GRID: Advancing South-East Europe into the eInfrastructure era 6

7. SEE-GRID-1 key results: infrastructure • Large, distributed infrastructure spanning all countries: • Including EGEE-SEE sites, without GR and HU: 30 sites, 450 CPUs • 150 CPUs in 20 non-EGEE-SEE sites • LCG-2 MW on Scientific Linux • Support the SEE-GRID Virtual Organization • Interconnection of SEE sites by P-GRADE portal • Catch-all SEE-GRID CA operational • Overlap with EGEE production • Operations centre management solutions deployed: a number of monitoring tools, helpdesk, sites database, etc… SEE-GRID: Advancing South-East Europe into the eInfrastructure era 7

8. SEE-GRID and EGEE • Infrastructure overlapping and complementing to EGEE • SEE-GRID open to new “fresher” sites • SEE-GRID open to new applications EGEE-wide VOs EGEE-SEE core services SEE-GRID VOs SEE-GRID core services EGEE-SEE Grid SEE-GRID Grid SEE-GRID: Advancing South-East Europe into the eInfrastructure era 8

9. SEE-GRID-1 key results: applications 2 regional grid applications developed: Search Engine for South-East Europe (SE4SEE) for Grid-aided web-crawling & data indexing. Volumetric Image Visualization Environment (VIVE) for medical images and other static or time-dependent scalar and vector 3D fields Both have been extensively tested and used in the SEE-GRID infrastructure EGEE applications are deployed on the sites which have been included in EGEE-SEE ROC and thus support these VOs (HEP, BioMed + other EGEE VOs!) SEE-GRID: Advancing South-East Europe into the eInfrastructure era 9

10. SEE-GRID-1 key results: - human network • The Human Network that will outlive the project • Dissemination • Policy and concertation • Conferences and publications • Relationships with other projects • Donations • NGIs • Trainings SEE-GRID: Advancing South-East Europe into the eInfrastructure era 10

11. SEE-GRID2www.see-grid.eu ITSEC V.Sidorenco11 RoEduNet2008 11 SEE-GRID: Advancing South-East Europe into the eInfrastructure era 11

12. SEE-GRID-2 project partners: expansion Start date: 01/05/2006 Duration: 24 months Total Budget: 2,028,886 Є Contractors GRNET Greece CERN Switzerland SZTAKI Hungary IPP-BAS Bulgaria ICI Romania TUBITAK Turkey ASA/INIMA Albania UoBL Bosnia-Herzegovina UKIM FYR of Macedonia UOB Serbia UoM Montenegro RENAM Moldova RBI Croatia 3 types of countries Third Parties 27 universities / research centres SEE-GRID: Advancing South-East Europe into the eInfrastructure era 12

13. SEE-GRID-2: new directions • Policy-focused deployment strategy • Shift priority from a “top-down” approach (i.e. from regional project execution to national implementation)towards a a “bottom-up” approach (from national priorities, cooperation, and innovation to regional cohesiveness) • Achieve Grid uptake and buy-in beyond the “usual suspects” of the R&E community (-> government, policy-makers, dialogue with industry…) • Growth of infrastructure • Expand regionally to include new countries/areas and widen the SEE eInfra community • Expand nationally to include new sites/institutes and strengthen collaboration in each country • Application-driven deployment approach • serve the needs of diverse and multi-disciplinary communities • extend the user-base – USE the grid, USE the network, USE the Infrastructure SEE-GRID: Advancing South-East Europe into the eInfrastructure era 13

14. SEE-GRID-2 objectives:ensure sustainable development Clear NGI strategy National government commitment and support for incubating NGIs Build solidarity and cooperation with research and academic organizations at national level Engage regional and national user communities Build long-term operational solutions: operations centres, CAs, etc, in each country SEE-GRID: Advancing South-East Europe into the eInfrastructure era 14

15. SEE-GRID-2 objectives: upgrade SEE grid infrastructure Upgrade the capacity of the regional pilot infrastructure Guarantee stability and interoperability of the infrastructure Support the accreditation of national Grid CAs. Strengthen operations at national level Deploy portal technology for accessing the grid and supporting application development and deployment Draw upon deployment experience/results of other grid projects (EGEE/EGEE-II, EUMEDGRID, BalticGrid, EELA, etc) SEE-GRID: Advancing South-East Europe into the eInfrastructure era 15

16. SEE-GRID-2 objectives:strengthen the human network Liaise with and beyond SEE user communities Training events at regional level for site admins and end-users at national-level Dissemination events at regional level for policymakers and public at large at national-level Regional eInfra projects Policy Workshop – September in Geneva! SEE-GRID: Advancing South-East Europe into the eInfrastructure era 16

17. SEE-GRID-2 - infrastructure • Number of Countries: 11 • Number of Sites: 31 • Number of CPUs: 540 • TBs of Storage: 80 • Migrating from LCG to gLite SEE-GRID: Advancing South-East Europe into the eInfrastructure era 17

18. Infrastructure management: monitoring SEE-GRID: Advancing South-East Europe into the eInfrastructure era 18

19. Infrastructure management: Helpdesk, database, wiki SEE-GRID: Advancing South-East Europe into the eInfrastructure era 19

20. Using the infrastructure • Going to website www.seegrid.eu • Talking to the SEEGRID representative in the country • Obtaining a certificate from SEE-GRID catch-all CA • Joining the SEE-GRID VO • Asking local country Grid team to provide support • More than 10+ new applications were developed, ~20 in the course of the project SEE-GRID: Advancing South-East Europe into the eInfrastructure era 20

21. Strategic priority: NGIs • Formation of stable NGIs is the key to long-term sustainability • National Grid Initiatives are concertated efforts taken at National level in order to deploy, operate, and expand grid infrastructures in a coherent and coordinated way • Usually involves the inter-connection and inter-operation of academic and research-based resource centers under an umbrella of a national program aiming to integrate the available resources in order to establish an e-Infrastructure for the benefit of the R&E (e-Science) community, and in the long-term for the society at large SEE-GRID: Advancing South-East Europe into the eInfrastructure era 21

22. MD-Grid NGI Kick-Off – May 2007 Establishment MD-Grid NGI in Moldova uses the model of Joint Research Unit (JRU) Consortium belonging to NREN, recognized as Coordinating body and based on: • Recognition and support by Ministry of Information Development of Moldova • Recognition and support by the Academy of Sciences of Moldova • Signed and adopted Agreement with NGI participants, that applied Letters of Intent to attend MD-Grid NGI Joint Research Unit SEE-GRID: Advancing South-East Europe into the eInfrastructure era 22

23. www.grid.md SEE-GRID: Advancing South-East Europe into the eInfrastructure era 23

24. MD-Grid NGI Members • RENAM - Coordinator • Faculty of Radioelectronics and Telecommuni-cations of Technical University of Moldova • Institute of Mathematics and Computer Science of Academy of Sciences of Moldova • Institute of Geophysics and Seismology of ASM • State Hydrometeorological Service • School of Public Health. State Medical and Pharmacy University of Moldova • Institute of Applied Physics of ASM Potential MD-Grid extension • State University of Moldova • Institute of Ecology and Geography of ASM • Academy of Economical Studies • Institute of Economy, Financing and Statistics of the Ministry of Economy and Trade • … • The list is open for any others …. Welcome! SEE-GRID: Advancing South-East Europe into the eInfrastructure era 24

25. MD-Grid NGI Aims and Tasks • MD-Grid NGI participates in strategic European Programs for the development of transnational grids and in initiatives for the completion of SEE eInfrastructures. The operation of the MD-Grid NGI implements the general EU policy on the development of national initiatives for the coordination of actions related to eInfrastructures and Grids. • The integration of Grid actions (infrastructures, middleware and applications) with the broadband research and technology network into a standard e-Infrastructures system. Optimization of exploitation of advanced network resources and services of RENAM which can serve the new e-Science generation and will attract the greater users community of the Information Society to the mass adoption of advanced services provided by Grid architectures. • Permanent development and administration of Grid sites infrastructure in Moldova SEE-GRID: Advancing South-East Europe into the eInfrastructure era 25

26. SEE-GRID-SCI: e-Infrastructure for regional e-science SEE-GRID: Advancing South-East Europe into the eInfrastructure era 26

27. SEE-GRID-SCI Participants SEE-GRID: Advancing South-East Europe into the eInfrastructure era 27

28. www.see-grid-sci.eu SEE-GRID: Advancing South-East Europe into the eInfrastructure era 28

29. SEE-GRID-SCI project partners Contractors GRNET Greece CERN Switzerland SZTAKI Hungary IPP-BAS Bulgaria ICI Romania TUBITAK Turkey ASA/INIMA Albania UoBL Bosnia-Herzegovina UKIM FYR of Macedonia UOB Serbia UoM Montenegro RENAM Moldova RBI Croatia IIAP-NAS-RA Armenia - new GRENA Georgia - new Third Parties 30 universities / research centres Start date: 01/05/2008 Duration: 24 months Total Budget: 2,499,969 Є SEE-GRID: Advancing South-East Europe into the eInfrastructure era 29

30. Applications area The project is focusing on forming regional research teams that are engaged in elaboration large scale applications of common interest. Three SEE-wide user communities were proposed: • Seismology VO • Meteorology VO • Environmental VO The work programme envisages analysis of the mentioned VOs requirements, their gridification and run-time support of the target applications. These three strategic Virtual Organisations will bring together users across the region within a common research space, enabling them to share data, applications, tools and results of their work. SEE-GRID: Advancing South-East Europe into the eInfrastructure era 30

31. New communities integration in the regional eInfastructure SEE-GRID: Advancing South-East Europe into the eInfrastructure era 31

32. MD-Grid Consortium in SEE-GRID-SCI Moldova participates in the project as MD-Grid JRU Consortium with RENAM as Contractor and following third parties - JRU members: • FRT TUM - Faculty of Radioelectronics and Telecommunications of Technical University of Moldova • IGS ASM - Institute of Geology and Seismology of Academy of Sciences of Moldova • SHMS - State Hydrometeorological Service of Moldova SEE-GRID: Advancing South-East Europe into the eInfrastructure era 32

33. Distribution of applications according to contributing countries SEE-GRID: Advancing South-East Europe into the eInfrastructure era 33

34. Evolution Productive Use Testbeds Utility National European e-Infrastructure Global www.eu-egi.eu 34 SEE-GRID: Advancing South-East Europe into the eInfrastructure era 34

35. Sustainable grid/data-based e-Infrastructures (utility model) Sustainable e-Infrastructures (utility model) FP7 Production quality facilities FP6 FP5 Broad scale test-beds Towards sustainable grid-empowered e-Infrastructures www.eu-egi.eu 35 Slide courtesy of Kyriakos Baxevanidis, EC SEE-GRID: Advancing South-East Europe into the eInfrastructure era 35

36. European Grid Initiative Goal: • Long-term sustainability of grid infrastructures in Europe • through establishment of a new federated model bringing together NGIs to build the EGIorganization EGIOrganization: • Coordination and operation of a common multi-national, multi-disciplinary Grid infrastructure • to enable and support international Grid-based collaboration, • to provide support and added value to NGIs, • and to liaise with corresponding infrastructures outside Europe SEE-GRID: Advancing South-East Europe into the eInfrastructure era 36

37. EGI Vision Paperhttp://www.eu-egi.org/vision.pdf • Provide global services and support that complement and/or coordinate national services (Authentication, VO-support, security, etc); • Coordinate middleware development and standardization to enhance the infrastructure by soliciting targeted developments from leading EU and National Grid middleware development projects; • Advise National and European Funding Agencies in establishing their programmes for future software developments based on agreed user needs and development standards; • Integrate, test, validate and package software from leading Grid middleware development projects and make it widely available; • Provide documentation and training material for the middleware and operations. (NGIs may wish to make the material available in turn in their local language); • Take into account developments made by national e-science projects which were aimed at supporting diverse communities. • Link the European infrastructure with similar infrastructures elsewhere; • Promote Grid interface standards based on practical experience gained from Grid operations and middleware integration activities, in consultation with relevant standards organizations; • Collaborate closely with industry as technology and service providers, as well as Grid users, to promote the rapid and successful uptake of Grid technology by European industry. SEE-GRID: Advancing South-East Europe into the eInfrastructure era 37

38. 38 European NGIs + Asia, US, Latin America + PRACE + OGF-Europe + … www.eu-egi.eu 38 SEE-GRID: Advancing South-East Europe into the eInfrastructure era 38

39. www.eu-egi.eu SEE-GRID: Advancing South-East Europe into the eInfrastructure era 39

40. Terminology “European Grid Initiative (EGI)” = the EGIorganization+ the NGIs “EGI Organization” = the team with central responsibility, including the management structure “EGI Council” = the governing body of the EGI and successor to the EGI Policy Board SEE-GRID: Advancing South-East Europe into the eInfrastructure era 40

41. EGI Grid Infrastructure … should be • a large-scale, production Grid infrastructure • built on national grids that interoperate seamlessly at many levels, • offering reliable and predictable services to a wide range of applications • creation and cooperation of Specialized Support Centers SEE-GRID: Advancing South-East Europe into the eInfrastructure era 41

42. EGI Infrastructure International Scientific and Research Collaboration EGI.org European-level Grid Services gLite UNICORE ARC Middleware A Middleware B Middleware B Middleware X NationalGridInitiative 1 NationalGridInitiative 2 NationalGridInitiative N … www.eu-egi.eu SEE-GRID: Advancing South-East Europe into the eInfrastructure era 42

43. NGI Resources for Operation • Estimated effort for NGI to be part of EGI • Financing long-term vision: • Membership fees from NGIs according to an EGI-key agreed by the EGI Council • Project grants, from EU and other funding bodies • Service charges, from NGIs and other buying specific services from EGI.org • Initial phase: • Only membership fees and project grants • Strong support from EC required to establish EGI model and to keep it at the leading edge of technology SEE-GRID: Advancing South-East Europe into the eInfrastructure era 43

44. Further recommendations • Carry out complementary but coordinated actions • Training! • NGI development, but allow for separate national strategies / agendas of NGIs • Broad partnerships through MoUs and joint work: EGEE, SEEGRID, other regions • Use EC financing as seed money – seek other sources • Organize in federations with clear relations and modus operandi; scalable structure needed • Distribute Grid and management services to spread the know-how and ensure joint responsibility and control • Aim to have possibility of stand-alone operations, independent on related federated Grids and projects • Adopt good technical solutions but also pursue alternatives • Have clear/quantified target/criteria for migrating to EGEE • To be involved in EGI SEE-GRID: Advancing South-East Europe into the eInfrastructure era 44

45. MD-GRID NGI - long-term strategy • Strategic success metrics of NGI: • not Gbps/sec • not the number of nodes • not the TBs of storage • The initiatives are puzzle pieces of RTD efforts to sustain national and regional development • Increasing the retention of talented scientists in the region • Pursuing joint R&D efforts among countries in the region • Making available the benefits of the Information Society for citizens • Easing the digital divide between the region and the countries at other side of spectrum • Improvement of regional competitiveness in all market sectors • Regional political stability and cohesiveness • The basis for new applications and national GRID infrastructure development • The sustainable status can be achieved by national RTD efforts combining with EC co – finding SEE-GRID: Advancing South-East Europe into the eInfrastructure era 45

46. Conclusions • SEE-GRID projects help to deploy a sustainable Grid infrastructure, which, coupled with human networking activities will be of particular societal, educational, and political importance to the SEE region and to Moldova especially. • Such modernization is a key goal of eEurope - which aims on accelerating the development of the Information Society in Europe and ensuring its availability to everyone. • Regional and National Grid infrastructures deployment will have a significant impact on the SEE region by helping the participating countries to achieve the goal to be a part of eEurope and align their national priorities with the EU recommendations and guidelines. SEE-GRID: Advancing South-East Europe into the eInfrastructure era 46