Extensions of the European Grid Infrastructure

1. Extensions of the European Grid Infrastructure Federico Ruggieri – INFN (Federico.Ruggieri@roma3.infn.it) IX International Conference on Science Arts and Culture ECSAC2009 - Veli Losinj - 29 August 2009

2. Outline • A bit of history (my version, sorry !) • The European Vision • Regional Grid Infrastructures co-funded by the European Commission • Commonalities and differences • A common strategy for the future • Conclusions

3. A bit of (my) short history of Grids • In the 80’ and early 90’ the accent was on client-server and meta-computing. • In 1998 I. Foster & K. Kesselman - The Grid: Blueprint for a New Computing Infrastructure • 1998 GRID presentation in CHEP’98 – Chicago. • 1999 Evaluation of Globus in INFN • 2000 CERN invited to take the lead of European Project on Grids with LHC computing as the main user. • 2000 - 2003 First EU Project DataGRID and PPDG & GRIPHYN in US. • 2003 – 2006 EGEE Project in EU and OSG in US • … etc.

4. Computing intensive science • Many vital challenges require community effort • Fundamental properties of matter • Genomics • Climate change • Medical diagnostics • Research is increasingly digital, with increasing amounts of data • Computation ever more demanding • e.g.: experimental science uses ever moresophisticated sensors • Huge amounts of data • Serves user communities around the world • International collaborations

5. e-Science Collaborations Grid Infrastructure Network Infrastructure The European Vision • The Research Network infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries’ • Projects: GEANT, SEEREN, EUMEDCONNECT, etc. • The Research Grid infrastructure provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems • Projects: EGEE, SEE-GRID, EUMEDGRID etc. • This integrated networking & grid environment is called electronic infrastructure (eInfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (eScience) • The creation of the eInfrastructure is a key objective of the European Research Area

6. Globalisation of Grid Infrastructures CNGrid EUAsiaGrid Garuda

7. Virtual Communities & Impact • e-Infrastructures support wide geographically distributed communities → enhance international collaboration of scientists → promote collaboration in other fields. • Grids and networks allow the access of many researchers to scientific resources (laboratories and data) → disparity can be reduced and larger participation and contributions to high quality research. • The e-Infrastructures promote the usage of network connectivity and stimulate scientific and technical development of countries → contribute to fight the digital divide and brain drain.

8. Two (at least) scenarios • Greenfield regions/countries • No previous Grid and e-Infrastructures activities • Scarce knowledge and/or experience in deploying/managing large e-Infrastructures. • Isolated spots of research activities with high computing demands. • Advanced regions/countries • e-Infrastructures already started/deployed • Locally developed MW. • Fair to good knowledge and experience in e-Infrastructures • High quality research groups and institutions with world wide collaborations.

9. Seek, identify, and support e-Science communities and deploy their applications Set-up and manage a Pilot Grid Infrastructure Disseminate, both “bottom-up” and “top-down”, the e-Infrastructure paradigm for long term sustainability of e-Science Train users and site administrators to use and operate an e-Infrastructure based on the EGEE middleware Consolidated Work-plan

10. Instruments & methods • National Grid Initiatives • Internal (national) Infrastructures sustainability is still an issue. • Regional coordination • Difficult to shape the demand of collaboration with Europe in a Regional perspective (bilateral agreements always preferred). • Coordination and interoperation with EGEE (in future with EGI). • Stable Communication Networks co-operations still under development. • Synergistic approach with GEANT and EU NRENs and specific regional networks projects, i.e. ALICE, EUMEDCONNECT2, TEIN3, ORIENT

11. Before SEE-GRID-SCI During SEE-GRID-SCI SEEGRID-SCI

12. BalticGrid II

13. EELA II

14. EUAsiaGrid INFN (IT)CESNET (CZ)NCeSS (UK)HealthGrid (FR)AdMU (PH)ANU (AU)ASGC (TW)ASTI (PH)HAII (TH)IDA (SG)IAMI (VN)ITB (ID)NECTEC (TH) UPM (MY)MIMOS (MY)

15. INFN - CNAF INFN -Roma3 ULAKBIM NGI NGI NGI NGI NGI NGI NGI NGI NGI NGI NGI HIAST INFN -Catania CYNET JUNet MA-GRID Univ. of Tunis GRNET IUGAZA Un. of Malta IUCC CERIST ERI/EUN EUMEDGRID

16. GARUDA & • The Department of Information Technology (DIT), Government of India has funded the Centre for Development of Advanced Computing (C-DAC) to deploy the nation-wide computational grid GARUDA. • In Proof of Concept (PoC) phase which ended on March 2008, 17 cities across the country were connected with an aim to bring “Grid” networked computing to research labs and industry. • From April 2008 the Foundation phase is in progress with an aim to include more users’ applications, providing Service Oriented architecture, improving network stability and upgrading grid resources.

17. CNGRID & • The China National Grid (CNGrid) Project is supported by the "High Performance Computer and its Kernel Software " project, which is a key project in the National High-Tech R&D Program (the 863 program). • CNGrid is equipped with independently developed grid oriented high performance computers(Lenovo DeepComp 6800, Dawning 4000A) and constructs an open grid environment by 8 nodes including Hongkong. • There are 11 application grids from various industies in CNGrid, such as National Geological Application Grid.

18. GOS to gLite pipeline Gateway

19. gLite to GOS Pipeline Gateway

20. Training, training, …. Training ! • First EUMEDGRID Grid School • (Cairo, Egypt, 17-28 April 2007) • 9 applications selected, all “gridified”, • 80 nodes, 4 grid sites, 6 Mb/s connection installed in a hotel

21. Workshops, conferences, events ! Policy agenda for e-Infrastructures in the Mediterranean Countries Jointly organised by EUMEDGRID, EUMEDCONNECT and GEANT2 • More than 60 high level participants (Ministers, Politicians, EC Officers, Telecom Operators). • High profile speakers (HRH Princess Sumaya of Jordan, Mr. Mashour Abudaka Minister, Palestine, Dr. Najib Abdul Wahed Deputy Minister of Higher Education for Scientific Research, Syria, etc.) and qualified participation of European Commission. • Final panel expressed a strong support for the continuation of e-Infrastructures in the Mediterranean.

22. e-Infrastructures across the Mediterranean Dissemination, … dissemination ! • Combined effort of EUMEDGRID, EUMEDCONNECT and GEANT2 • Distributed in the folder of the Ministerial event in Cairo. http://ec.europa.eu/information_society/activities/internationalrel/dialogue_coop/euromed/docs_euromed/e_infrastructures_across_the_mediterranean_2008.pdf

23. Policy, policy,….policy ! 14. The Ministers stressed the fundamental need to ensure interconnection of research networks to support, inter alia, the creation of grid-enabled scientific e-Infrastructures able to make ICT Research and Development cooperation between Europe and the Mediterranean countries more efficient; »Building an Enabling Environment for the EUROMED Information Society« Cairo 27 February 2008 http://www.euromedinfo.eu/site.168.news.en.3214.html

24. ARN - Dz GRNET - Gr - It RED.ES - Es TUBITAK - Tr IUCC - Il JUNET - Jo MARWAN - Ma EUN - Eg CYNET - Cy Networks, networks, …. Networks !

25. Specific topics • In Greenfield regions: • gLite and European approaches have been exported; • the Grid infrastructures have been promoted and are not yet sufficiently mature to be sustainable; • In large, rapidly developing, countries: • they have already well defined Grid infrastructures (China, India); • different Middleware implementations (not only gLite and ARC); • Internal (national) sustainability should not be an issue. • Interoperability and interoperations with European Infrastructures and sustainability are the main goals • presently addressed in the activities of short lived projects (2 years max.) with different speeds and time shifts due to the different EU calls where they have been approved; • coordination, alignment of results, common road-maps are difficult to achieve, although being strongly pursued by all the projects.

26. What’s next • A new step forward - International Virtual Research Organisations highly need e-Infrastructures with coordinated management and support to create truly global communities in the future. • Value for EU - Europe has decisively contributed to the advent of e-Infrastructures in emerging regions (Asia, LA, Mediterranean) and new candidate EU countries (SEE, Baltic). Their evolution towards sustainable regional e-Science infrastructures should be finalised. • Possible objectives: • Enhance the collaboration / coordination and harmonisation of European and non-European e-Infrastructures in coherence with the EGI implementation. • Co-ordinate and support the dissemination towards politicians and stakeholders for long term sustainability of e-Infrastructures in the regions concerned. • Actively promote the adoption of standards and interoperable middleware solutions among the different regions.

27. CHAIN proposal • EU partners: those managing past and existing initiatives of Regional Grid Infrastructures • A number of non-EU partners as representatives of their regions (Maximum 10). The preferred choice will be to have a JRU or a single Organisation representing the whole region. • Activities • Policy Development – coherent scheme of cooperation and interoperation of European and non-EU e-Infrastructures • Technical – export EGI supported solutions and promote interoperation with other non-EU e-Infrastructures. • Leverage on cross-region communities and applications, promote inter-regional, e-Infrastructures based, research infrastructures.

28. 2009 2010 2011 2012 Timing EGEE III EGI EELA II BalticGrid II EUAsiaGrid SEEGRID-SCI CHAIN EUMEDGRID-Support EUIndiaGrid2

29. Conclusions • It’s a long road … to build stable e-Infrastructures, even in Europe. An unreasonable acceleration can’t be applied to other regions. • On the other hand many of those regions need to accelerate in order to catch up the more developed countries. • However, some rapidly developing countries have already made it and are willing to interoperate with similar Infrastructures in other regions of the world. • World wide spread scientific communities have started to appreciate the opportunities of working together on large inter-regional e-Infrastructures. • It’s time to produce a coherent, multi-region and multi-path road-map for the sustainability and interoperations of those Regional infrastructures towards EGI and among themselves.

30. Thank you !