1 / 33

International e-Infrastructure

International e-Infrastructure. Mike Mineter mjm@nesc.ac.uk. Overview. The view from the European Commission GEANT – European network DEISA – for when High Performance Computing is just not HP enough! EGEE – establishing grid e-Infrastructure WHY?! HOW?! With whom?.

branden-fitzpatrick
Download Presentation

International e-Infrastructure

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. International e-Infrastructure Mike Mineter mjm@nesc.ac.uk

  2. Overview • The view from the European Commission • GEANT – European network • DEISA – for when High Performance Computing is just not HP enough! • EGEE – establishing grid e-Infrastructure • WHY?! • HOW?! • With whom? International e-Infrastructure

  3. View from European Commission • Entering the “knowledge society” from the “industrial society” Industrial society = Transportation Infrastructure Knowledge society = Communications infrastructure • Lisbon strategy: Research and Innovation will be the most important factors in determining Europe’s success through the next decades • THE GOAL: “UNLEASH CREATIVITY”- by investment in • Human skills • Infrastructures • Demands in growth of e-infrastructure International e-Infrastructure

  4. HOW DEISA EGEE Market + 18 proposals international, policies, user communities GRID . INFRASTRUCTURE e-Infrastructure Research IST … GÉANT . INFRASTRUCTURE GÉANT2 e-Infrastructure - Strategic building blocks Mário Campolargo DG INFSO F3, Pisa 24th October 2005

  5. DEISA • “integration of existing national high-end platforms, tightly coupled by a dedicated network and supported by innovative system and grid software” • Initial scientific applications include • Material Sciences • Cosmology • Plasma Physics • Life Sciences • http://www.deisa.org International e-Infrastructure

  6. GEANT • Interconnects 34 National Research & Education Networks-NRENs of the extended European Research Area (ERA) • Connects more than 3500 Research & Education Institutions • Serves millions of end-users + eScience Projects (e.g. Grids) under Accepted Usage Policy (AUP) rules • 3-tier Federal Architecture, partially subsidized by National and EU Research & Education funds: • The Campus Network (LAN/MAN) • The NREN (MAN/WAN) • The Pan-European Interconnection • GEANT2 en route • http://www.geant.net/ International e-Infrastructure

  7. EGEE: Enabling Grids for E-sciencE International e-Infrastructure

  8. 70 leading institutions in 27 countries, federated in regional Grids ~32 M Euros EU funding for first 2 years starting April 2004(matching funds from partners) Leveraging national and regional gridactivities Promoting scientific partnershipoutside EU EGEE Organisation International e-Infrastructure

  9. Pilot New In its first 2 years EGEE • Goal: establish production quality sustained Grid services with • 3000 users from at least 5 disciplines • integrate 50 sites into a common infrastructure • offer 5 Petabytes (1015) storage • Achieved • > 180 sites in 39 countries • ~ 20 000 CPUs • > 5 PB storage • > 10 000 concurrent jobs per day • > 60 Virtual Organisations International e-Infrastructure

  10. LCG and EGEE LCG : Large Hadron Collider Compute Grid • EGEE committed to “hit the ground running” • EGEE profits from the resources - no funded computing/data resources in EGEE • Provided by the VOs • LCG obtains additional production and operation efforts • LCG experiments now comprise several of the many VOs in EGEE • Current service (“LCG-2”) based on work done in LCG • Middleware components to be upgraded by “gLite” services as they are proven • “gLite 3” will be forged from LCG 2.7 + gLite services International e-Infrastructure

  11. EGEE Activities • 48 % service activities (Grid Operations, Support and Management, Network Resource Provision) • 24 % middleware re-engineering (Quality Assurance, Security, Network Services Development) • 28 % networking (Management, Dissemination and Outreach, User Training and Education, Application Identification and Support, Policy and International Cooperation) Emphasis in EGEE is on operating a production grid and supporting the end-users International e-Infrastructure

  12. Operations International e-Infrastructure

  13. International e-InfrastructureInternational e-Infrastructure

  14. Building user communities International e-Infrastructure

  15. Application Developers Successful Users Application Developers At home on EGEE Trainers power Virtuous Cycles User Registration Outreach Dissemination User Induction Training Researchers Diagnosticians Designers Dissemination Advanced EGEE Applications Success Stories & Experts Developer Initial Training Positive Referrals New EGEE Applications Developer Advanced Training Positive Referrals Pushing Limits International e-Infrastructure

  16. The GILDA Test-bed(https://gilda.ct.infn.it/testbed.html) Beijing (IHEP) 20 sites in 3 continents ! International e-Infrastructure

  17. GILDA demonstrator and testbed(https://gilda.ct.infn.it) Marc-Elian Bégin - Demos - 1st EU review

  18. t-Infrastructure • Why t-infrastructure? • Training is necessary: personal + e-learning • e-Infrastructure for production • t-Infrastructure for training • Need guaranteed response for tutorials; limit the vulnerability of production systems • use training grid • have training CA • able to change middleware to prepare participants for future releases on production system • need safe resources for installation training • easy entry point for new communities International e-Infrastructure

  19. International cooperation International e-Infrastructure

  20. Condor Globus MyProxy ... EDG . . . VDT LCG Parts of the Grid “ecosystem” 2001 OSG, … DataTAG CrossGrid ... SRM 2004 GridCC NextGrid EGEE DEISA … interactive USA EU Used in Future grids International e-Infrastructure

  21. Policy and International Cooperation • Cooperation between EGEE and other Grid activities • Globus Alliance, Condor • Training/workshop events (International Summer School of Grid Computing, July… 2 intense weeks… registrations open! http://www.dma.unina.it/~murli/ISSGC06/ ) • eInfrastructure reflection group in Europe http://www.e-irg.org/ • Standard setting through attendance at global standard bodies such as the Global Grid Forum. • Grid Storage Management GGF working group - http://sdm.lbl.gov/gsm/ • Security, Authentication: US – EU cooperation • Mutual recognition of Certificate Authorities • Requires collaboration to establish policy - and mutuality International e-Infrastructure

  22. EGEE-II International e-Infrastructure

  23. EGEE-II • EGEE-II proposal submitted to the EU • Proposed start 1 April 2006 • Natural continuation of EGEE • Expanded consortium • Emphasis on providing an infrastructure  increased support for applications  interoperate with other infrastructures  more involvement from Industry International e-Infrastructure

  24. EGEE-II: Expertise & Resources • More than 90 partners • 32 countries • 12 federations  Major and national Grid projects in Europe, USA, Asia + 27 countries through related projects: • BalticGrid • SEE-GRID • EUMedGrid • EUChinaGrid • EELA International e-Infrastructure

  25. Related Projects International e-Infrastructure

  26. Invests Strengthens Organisation Services & Applications Training Develop Prepares Skilled Workers Invests Enriches Society Innovation Education Create Prepares Graduates International Collaboration to Extend and Advance Grid Education – ICEAGE International Collaboration to Extend and Advance Grid Education – ICEAGE • Training • Targeted • Immediate goals • Specific skills • Building a workforce • Education • Pervasive • Long term and sustained • Generic conceptual models • Developing a culture • Both are needed Malcolm Atkinson 23rd March 2006

  27. EGEE is running… • … the largest multi-VO production grid in the world! • What’s happening now?http://gridportal.hep.ph.ic.ac.uk/rtm/ • What resources are connected?http://goc.grid-support.ac.uk/gridsite/monitoring/ International e-Infrastructure

  28. Can you use the EGEE grid?! • Yes - if you are in a VO that has been accepted! • Probably - if you are in an international VO willing to apply and (probably) contribute some resources • (contrasting policy with the NGS – appropriate because EGEE is seeking to federate national grids, not replace them!) • BUT • ANYONE can apply for an account on GILDA to gain experience International e-Infrastructure

  29. Interoperability amongst production grids International e-Infrastructure

  30. Glance at Interoperability • Interoperability can be sought at: • Application layer – as P-GRADE shows (and others!) • Grid layer – GIN: Grid Interoperability Now • GGF initiative – ~18 grids • EGEE, OSG (in the US), NAREGI (Japan)……. Are production grids providing a service now • Translations and glue • between “islands” sharing different de-facto standards e.g. different information systems in EGEE, GT4 and UNICORE grids • Service layer – here reliant on standards and on architecture International e-Infrastructure

  31. A glance at Nextgrid • Based on service orientation and emerging standards, its big themes include: • workflow • brokering, planning, reservation • languages raise level of abstraction • service level agreements • not exactly like that with electricity supplier! • have to be interpreted not by courts but prescriptions of what want/offered that can be matched computationally • define composition, relationship between consumer and provider • Requires accounting International e-Infrastructure

  32. Summary • EGEE is running the largest multi-VO grid in the world! • Creating the “grid layer” in e-Infrastructure • Seeking to federate national grids – NGS • Key concepts for EGEE • Sustainability – planning for the long-term • Production quality • And… • Grids are fundamentally about people • … how people in different organisations commit to cooperate • … and how that cooperation can be enabled by operations, training, support, and (most transient of all!) middleware International e-Infrastructure

  33. Further information • EGEE Website http://www.eu-egee.org • How to join http://public.eu-egee.org/join/ • EGEE Project Office project-eu-egee-po@cern.ch • Global Grid Forum http://www.gridforum.org/ • Globus Alliance http://www.globus.org/ • Condor http://www.cs.wisc.edu/condor/ • VDT http://www.cs.wisc.edu/vdt/ • Open Science Grid http://www.opensciencegrid.org/ • Grid Center http://www.grids-center.org/ • LCG http://lcg.web.cern.ch/LCG/ International e-Infrastructure

More Related