1 / 25

The LHC Computing Grid

The LHC Computing Grid. Visit of Mr. Daniel Valtchev, Bulgarian Deputy Prime Minister and Minister for Science and Education. Frédéric Hemmer Deputy Head, IT Department 18 December 2007. The LHC Data Challenge. The accelerator will be completed in 2008 and run for 10-15 years

barryfreeman
Download Presentation

The LHC Computing Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The LHC Computing Grid Visit ofMr. Daniel Valtchev, Bulgarian Deputy Prime Minister and Minister for Science and Education Frédéric HemmerDeputy Head, IT Department 18 December 2007 Wolfgang von Rüden, CERN, IT Department

  2. The LHC Data Challenge • The accelerator will be completed in 2008 and run for 10-15 years • Experiments will produce about15 Million Gigabytes of data each year (about 20 million CDs!) • LHC data analysis requires a computing power equivalent to ~100,000 of today's fastest PC processors • Requires many cooperating computer centres, as CERN can only provide ~20% of the capacity Frédéric Hemmer, CERN, IT Department

  3. CPU Disk Tape Frédéric Hemmer, CERN, IT Department

  4. Solution: the Grid • Use the Grid to unite computing resources of particle physics institutes around the world • The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations • The Grid is an infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe Frédéric Hemmer, CERN, IT Department

  5. How does the Grid work? • It makes multiple computer centres look like a single system to the end-user • Advanced software, called middleware, automatically finds the data the scientist needs, and the computing power to analyse it. • Middleware balances the load on different resources.It also handles security, accounting, monitoring and much more. Frédéric Hemmer, CERN, IT Department

  6. View of the ATLAS detector (under construction) 150 million sensors deliver data … … 40 million times per second Frédéric Hemmer, CERN, IT Department

  7. Wolfgang von Rüden, CERN, IT Department

  8. Wolfgang von Rüden, CERN, IT Department

  9. Wolfgang von Rüden, CERN, IT Department

  10. LHC Computing Grid project (LCG) • More than 140 computing centres • 12 large centres for primary data management: CERN (Tier-0) and eleven Tier-1s • 38 federations of smaller Tier-2 centres • 35 countries involved Frédéric Hemmer, CERN, IT Department

  11. Tier-1: “online” to the data acquisition process  high availability • Managed Mass Storage – grid-enabled data service • Data-heavy analysis • National, regional support Canada – Triumf (Vancouver) France – IN2P3 (Lyon) Germany – Forschunszentrum Karlsruhe Italy – CNAF (Bologna) Netherlands – NIKHEF/SARA (Amsterdam) Nordic countries – distributed Tier-1 Spain – PIC (Barcelona) Taiwan – Academia SInica (Taipei) UK – CLRC (Oxford) US – FermiLab (Illinois) – Brookhaven (NY) LCG Service Hierarchy • Tier-0: the accelerator centre • Data acquisition & initial processing • Long-term data curation • Distribution of data  Tier-1 centres • Tier-2: ~140 centres in ~35 countries • Simulation • End-user analysis – batch and interactive Frédéric Hemmer, CERN, IT Department

  12. Frédéric Hemmer, CERN, IT Department

  13. The new European Network Backbone • LCG working group with Tier-1s and national/ regional research network organisations • New GÉANT 2 – research network backbone  Strong correlation with major European LHC centres • Swiss PoP at CERN Frédéric Hemmer, CERN, IT Department

  14. WLCG Collaboration • The Collaboration • 4 LHC experiments • ~140 computing centres • 12 large centres (Tier-0, Tier-1) • 38 federations of smaller “Tier-2” centres • ~35 countries • Memorandum of Understanding • Agreed in October 2005, now being signed • Resources • Focuses on the needs of the four LHC experiments • Commits resources • each October for the coming year • 5-year forward look • Agrees on standards and procedures • Relies on EGEE and OSG (and other regional efforts) Frédéric Hemmer, CERN, IT Department

  15. Ramp-up to First Physics Run 2.3 X 2.9 X 3.7 X 3 X Sep Jul Apr -06 -07 -08 Sep Jul Apr -06 -07 -08 3.7 X target usage usage pledge installed Sep Jul Apr -06 -07 -08 Jul Sep Apr -07 -07 -08 Sep Jul Apr -06 -07 -08

  16. Grid Activity Continuing increase in usage of the EGEE and OSG grids All sites reporting accounting data (CERN, Tier-1, -2, -3) Increase in past 17 months – 5 X number of jobs - 3.5 X cpu usage 100K jobs/day

  17. Impact of the LHC Computing Grid in Europe • LCG has been the driving force for the European multi-science Grid EGEE (Enabling Grids for E-sciencE) • EGEE is now a global effort, and the largest Grid infrastructure worldwide • Co-funded by the European Commission (Cost: ~130 M€ over 4 years, funded by EU ~70M€) • EGEE already used for >20 applications, including… Bio-informatics Education, Training Medical Imaging Frédéric Hemmer, CERN, IT Department

  18. The EGEE project EGEE-II Partner in Bulgaria:Institute for Parallel Processing – Bulgarian Academy of Sciences, Sofia • EGEE • Started in April 2004, now in second phase with 91 partners in 32 countries • 3rd phrase (2008-2010) in preparation • Objectives • Large-scale, production-quality grid infrastructure for e-Science • Attracting new resources and users from industry as well asscience • Maintain and further improve“gLite” Grid middleware

  19. Applications on EGEE Summary of applications report: https://edms.cern.ch/document/722132 • More than 25 applications from anincreasing number of domains • Astrophysics • Computational Chemistry • Earth Sciences • Financial Simulation • Fusion • Geophysics • High Energy Physics • Life Sciences • Multimedia • Material Sciences • …..

  20. Increasing workloads Still expect factor 5 increase for LHC experiments over next year 32% 20

  21. Example: EGEE Attacks Avian Flu • EGEE used to analyse 300,000 possible potential drug compounds against bird flu virus, H5N1. • 2000 computers at 60 computer centres in Europe, Russia, Asia and Middle East ran during four weeks in April - the equivalent of 100 years on a single computer. • Potential drug compounds now being identified and ranked. Neuraminidase, one of the two major surface proteins of influenza viruses, facilitating the release of virions from infected cells. Image Courtesy Ying-Ta Wu, AcademiaSinica.

  22. Example:Geocluster industrial application • The first industrial application successfully running on EGEE • Developed by the Compagnie Générale de Géophysique (CGG) in France, doing geophysical simulations for oil, gas, mining and environmental industries. • EGEE technology helps CGG to federate its computing resources around the globe.

  23. Sustainability • Need to prepare for permanent Grid infrastructure • Ensure a high quality of service for all user communities • Independent of short project funding cycles • Infrastructure managed in collaboration with National Grid Initiatives (NGIs) • European Grid Initiative (EGI) Supporting NGI: SAITC in Sofia Frédéric Hemmer, CERN, IT Department

  24. EGEE All Activity Meeting

  25. For more information about the Grid: www.gridcafe.org www.cern.ch/lcg www.eu-egee.org www.eu-egi.org/ Thank you for your kind attention! Frédéric Hemmer, CERN, IT Department

More Related