1 / 17

Introduction to EGEE-II

Introduction to EGEE-II. Antonio Fuentes Antonio.fuentes@rediris.es Tutorial Grid Madrid, May 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II Project ). The project. EGEE 1 April 2004 – 31 March 2006 71 partners in 27 countries, federated in regional Grids EGEE-II

Download Presentation

Introduction to EGEE-II

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Introduction to EGEE-II Antonio Fuentes Antonio.fuentes@rediris.es Tutorial Grid Madrid, May 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II Project )

  2. The project • EGEE • 1 April 2004 – 31 March 2006 • 71 partners in 27 countries, federated in regional Grids • EGEE-II • 1 April 2006 – 31 March 2008 • 91 partners in 32 countries • Objectives • Large-scale, production-quality grid infrastructure for e-Science • Attracting new resources and users from industry as well asscience • Maintain and further improve“gLite” Grid middleware

  3. Applications on EGEE • Applications from many scientific domains • Archaeology • Astrophysics • Computational Chemistry • Digital libraries • Earth Sciences • Financial Simulation • Fusion • Geophysics • High Energy Physics • Life Sciences • Multimedia • Material Sciences • ….. Book of abstracts:http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-005.pdf

  4. KNOWLEDGE . INFRASTRUCTURE GRID . INFRASTRUCTURE GÉANT . INFRASTRUCTURE Support for digital repositories • 3 layered model to support access to heterogeneousinformation and connect resources throughcommon shared services • Grids can offer: • Sharing of resources • Secure Access Control • Data management • Execution of computationally demanding applications (e.g. multi-media content)

  5. EGEE Operations Structure • Operations Coord. Centre (OCC) • Regional Operations Centres (ROC) • Front-line support for user and operations issues • Provide local knowledge and adaptations • One in each region – many distributed • Manage daily grid operations – oversight, troubleshooting • “Operator on Duty” • Run infrastructure services ROCs serving

  6. Grid monitoring tools • Tools used by the Grid Operator on Duty team to detect problems • Distributed responsibility • CIC portal • single entry point • Integrated view of monitoring tools • Site Functional Tests (SFT) -> Service Availability Monitoring (SAM) • Need to expand usage in • GIIS monitor (Gstat) • GOC certificate lifetime • GOC job monitor

  7. GIN EGEE Related Infrastructures

  8. Grid Interoperability • We currently see different flavors of Grids deployed worldwide • Because of application needs, legacy constraints, funding, etc. • Diversity is positive! – Competition to find the best solutions • Many applications need to operate on more than one Grid infrastructure • Pragmatic approach to interoperability is key • Applications need interoperable Grid infrastructures now • A production infrastructure cannot be an early adopter of quickly changing standards • Interoperability and standardization pursued at multiple levels • Bilateral efforts (e.g. EGEE and EUChinaGrid, OSG and TeraGrid, EGEE and Naregi) • Resulted in the “Grid Interoperability Now (GIN)” effort combining major worldwide and regional Grid efforts at GGF • Grid standardization and best practices at the Global Grid Forum • Now merging with comparable industry efforts – Open Grid Forum • Standardization of basic infrastructure like web services (OASIS)

  9. Grid Middleware Applications • Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware • Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory • Foundation Grid Middleware will be deployed on the EGEE infrastructure • Must be complete and robust • Should allow interoperation with other major grid infrastructures • Should not assume the use of Higher-Level Grid Services Higher-Level Grid Services Workload Management Replica Management Visualization Workflow Grid Economies ... Foundation Grid Middleware Security model and infrastructure Computing (CE) and Storage Elements (SE) Accounting Information and Monitoring

  10. EGEE Middleware Distribution • gLite • Exploit experience and existing components from VDT (Condor, Globus), EDG/LCG, and others • Develop a lightweight stack of generic middleware useful to EGEE applications (HEP and Biomedics are pilot applications). • Pluggable components – cater for different implementations • Follow SOA approach, WS-I compliant where possible • Focus is on re-engineering and hardening • Business friendly open source license • Plan to switch to Apache-2

  11. gLite Grid Middleware Services Access Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf CLI API Security Information & Monitoring Authorization Auditing Information &Monitoring Application Monitoring Authentication Data Management Workload Management MetadataCatalog File & ReplicaCatalog Accounting JobProvenance PackageManager Site Proxy StorageElement DataMovement ComputingElement WorkloadManagement

  12. gLite Grid Middleware Services Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf

  13. EGEE and Sustainability BUT … • How does EGEE compare to other computing infrastructures? • Number of infrastructure users? • Number of application domains? • Number of computing nodes? • Number of years in service? • What would happen, if EGEE is turned off? • What happens after April 2008 (End of EGEE-II)?

  14. Sustainability: Beyond EGEE-II • Need to prepare for permanent Grid infrastructure • Maintain Europe’s leading position in global science Grids • Ensure a reliable and adaptive support for all sciences • Independent of short project cycles • Modelled on success of GÉANT • Infrastructure managed in collaboration with national grid initiatives

  15. Structure • Federated model bringing together National Grid Initiatives (NGIs) to build a European organisation (EGI) • EGEE-II federations wouldevolve into NGIs • Each NGI is a national body • Recognised at the national level • Mobilises national funding and resources • Contributes and adheres to international standards and policies • Operates the national e-Infrastructure • Is application independent, open to new user communities and resource providers

  16. EGEE’06 Conference • EGEE’06 – Capitalising on e-infrastructures • Keynotes on state-of-the-art and real-world use • Dedicated business track exploring Grids’ business potential • Demos and business/industry exhibition • Involvement of international community • 25-29 September 2006 • Geneva, Switzerland • http://www.eu-egee.org/egee06

  17. Summary • Grids are all about sharing – they are an excellent means of working with groups around the world • EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research • In constant and significant production use • EUMedGrid & EUChinaGrid as part of this production infrastructure • We have gained significant experience in what it takes to deploy, operate and manage a large distributed infrastructure • Next steps: Service Availability Monitoring, Service Level Agreements • This work has shown the importance of interoperability/interoperations with related projects • Need to prepare the long-term • EGEE, related EU projects, national grid initiatives and user communities are working to define a model for a sustainable grid infrastructure

More Related