Lcg france
This presentation is the property of its rightful owner.
Sponsored Links
1 / 35

LCG-France PowerPoint PPT Presentation


  • 98 Views
  • Uploaded on
  • Presentation posted in: General

LCG-France. Vincent Breton, Eric Lançon and Fairouz Malek, CNRS-IN2P3 and LCG-France ISGC Symposium Taipei, March 27th 2007. LCG-France Project. Goals Setup, develop and maintain a LCG Tier-1 and an Analysis Facility at CC-IN2P3

Download Presentation

LCG-France

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Lcg france

LCG-France

Vincent Breton, Eric Lançon and Fairouz Malek,

CNRS-IN2P3 and LCG-France

ISGC Symposium

Taipei, March 27th 2007


Lcg france project

LCG-France Project

  • Goals

    • Setup, develop and maintain a LCG Tier-1 and an Analysis Facility at CC-IN2P3

    • Promote the creation and coordinate the integration of Tier-2/Tier-3 french sites into the LCG collaboration

  • Funding

    • national funding for tier-1 and AF

    • Tier-2s and tier-3s funded by universities, local/regional governments, hosting laboratories, …

  • Organization

    • Started in June 2004

    • Scientific and technical leaders appointed, management board (executive) and overview boards in place since then

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Lcg france sites

LCG-France sites

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Lcg france contribution october 2005 september 2006

LCG France contribution (October 2005 - September 2006)

  • EGEE « CPU accounting » per EGEE region

    • French contribution includes LCG-France sites

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Sites contribution to lcg france september 2005 october 2006

sites contribution to LCG France (September 2005 - October 2006)

  • « CPU accounting » per site for all EGEE Virtual Organizations

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 contribution

Tier-1 Contribution

  • Planned contribution of LCG-France Tier-1

    • % of required resources for all tier-1s in 2008

Source: Comparison of New Requirements with Current Pledges – 24/10/2006

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 contribution cont

Tier-1 Contribution (cont.)

  • Planned contribution of LCG-France tier-1

    • % of required resources in all tier-1s in 2008 (to be finalized)

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 2s contribution

Tier-2s Contribution

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 planned evolution

Tier-1 Planned Evolution

Increase rate over the period 2006-2010:

CPU: x 17

DISK: x 16

MSS: x 18

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 2s planned evolution

Tier-2s Planned Evolution

Roughly equivalent to the planned Tier-1 CPU capacity the same year

43% of the planned Tier-1 disk capacity the same year

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 3s planned evolution

Tier-3s: Planned Evolution

Data for IPNL (Lyon) are not included

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 2 tier 3 activities

Tier-2/Tier-3 Activities

  • Coordination of LCG-France tier-2/tier-3 technical activities officially set up in April 2006

    • Frédérique Chollet is leading the group

    • Collaboration tools in place

      • Mailing list, wiki pages, regular video-conference meetings

  • Activities

    • Very active in the Quattor working group

      • Used by most of the LCG-France sites

    • Network-level and SRM-level data transfer tests from and to tier-1

      • Including associated foreign sites (more on this later)

    • Meetings held with several potential hardware providers

      • Sharing of technical and commercial information (hardware evaluation results, commercial conditions, etc.)

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 2 tier 3 activities cont

Tier-2/Tier-3 Activities (cont.)

  • In close contact with some foreign associated tier-2s

    • Europe

      • Belgium CMS Tier-2

      • Romanian Federation ATLAS Tier-2

    • Asia

      • IHEP China - ATLAS and CMS Tier2

      • ICEPP Japan - ATLAS Tier2

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 site overview

VO Box

VO LHC

Système d’information de la grille

VO Box

VO LHC

V OBox

VO LHC

MonBox

4 Sites

VOMS

4 VOs

VO Box

VO LHC

FTS

4 VOs LHC

LFC Local

4 VOs LHC

LFC Central

Biomed

Site BDII

Gridftp

SRM

Gridftp

Computing

Element

Computing

Element

Storage

Element

Storage

Element

Storage

Element

BQS

XFS

HPSS

DCACHE

Service global

WN

WN

WN

WN

WN

WN

WN

WN

Anastasie

Service régional/fédéral

Service local

Calcul

Stockage

Tier-1: site overview

Courtesy of Pierre Girard

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 site overview cont

Tier-1: site overview (cont.)

  • Operating also several grid services for non-LHC VOs

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 contribution in 2006

Tier-1 Contribution in 2006

  • CPU time contributed by the french tier-1 in 2006

    • % of CPU time (grid and non-grid) used by the experiments in all the tier-1s

The CC-IN2P3 contribution to the global effort in 2006 was 10% of the total CPU used by the 4 experiments in all the tier-1s.

Source: WLCG Accounting Report Tier-1 Centres + CERN

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 contribution in 2006 cont

Tier-1 Contribution in 2006 (cont.)

  • CPU utilisation by LHC experiments at all the tier-1s and at CC-IN2P3

All Tier-1s

(does not include non-grid usage of some sites)

CC-IN2P3 (grid and non-grid)

Source: http://www3.egee.cesga.es/gridsite/accounting/CESGA/tier1_view.html

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 grid vs non grid usage

Tier-1: grid vs. non-grid usage

  • Site usage (grid vs. non-grid) greatly varies from one experiment to another

    • Both in terms of consumed capacity and number of jobs

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 efficiency cpu time vs wallclock

Tier-1: efficiency (CPU time vs. wallclock)

Measurement error.

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 cpu planned vs actual consumption

Tier-1: CPU planned vs. actual consumption

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 cpu capacity delivered

Tier-1: CPU capacity delivered

Several service interruptions in august and september due to problems with the cooling or power infrastructure

4 days-long scheduled complete shutdown of the site for replacing some central electric equipement

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 storage delivered

Tier-1: storage delivered

  • Disk storage capacity

    • Delivered 34% (180 TB out of 520 TB planned)

    • More on this later

  • Tape storage capacity

    • Installed capacity (as planned) of 535 TB (of which 73% was actually used)

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 data transfer exercises

Target: 200 MB/sec

Target: 75 MB/sec

Tier-1: data transfer exercises

  • CERN → CC-IN2P3 (disk)

    • April 2006

  • CERN → CC-IN2P3 (MSS)

    • April 2006

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 site availability

Tier-1: site availability

Source: http://lcg.web.cern.ch/LCG/MB/availability/site_reliability.pdf

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 capacity increase in 2006

Tier-1: capacity increase in 2006

  • CPU

    • +265 worker nodes (IBM, dual-processor dual-core AMD Opteron 275, 2.2 GHz, 2 GB/core, 290 GB internal disk)

    • Theoretical power: 1573 SI2000 per core

      • Total: 1,6 M SI2000

      • Observed power with typical applications is ~30% less than theoretical

  • Disk storage

    • +400 TB of rack-mounted Sun Fire X4500 (aka Thumper)

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 capacity increase in 2006 cont

Tier-1: capacity increase in 2006 (cont.)

  • Tape storage

    • Call for tender for a new cartridge library

    • Selected Sun/StorageTek SL8500

      • 30 T10000 drives

      • 10 LTO-3 drives

    • Will progressively replace the current one

      • 6 silos

    • Installation started in January

      • Expected to be finished by end of april 2007

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Tier 1 capacity increase in 2006 cont1

Tier-1: capacity increase in 2006 (cont.)

  • Databases

    • Reconfiguration of Oracle cluster

      • Extensible hardware architecture

    • +1 TB added to the dedicated SAN (2 TB total)

    • +3 front-end database servers (5 total)

      • 2 of them will share the load of the LHC experiments

  • International connectivity

    • Dedicated link CC-IN2P3↔CERN 10 Gbps

    • 2 x 1 Gbps links CC-IN2P3 ↔ Fermilab

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Hardware procurement

Hardware procurement

  • Procurement process (evaluation, publication, selection) is more or less under control

    • Delivery delays are not!

    • In 2006, we suffered delivery delays of several months for some equipment

      • A fraction of the equipment is still not delivered!

  • Procurement of equipment is an issue

    • Several constraints: space in the machine room, budget constraints, delivery delays, requested availability, …

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Facility upgrade

Average total electrical power monthly consumption

Facility Upgrade

  • Major effort for upgrading the electric and cooling infrastructure of the site

    • Currently reaching the limits of the installation

    • When the current works will be finished (april 2007)

      • from 500 kW to 1000 kW usable for computing equipement

Courtesy of Dominique Boutigny

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Facility upgrade cont

Facility Upgrade (cont.)

  • Scheduled 4 days-long complete shutdown of the site in December 2006 for replacing central electric equipment

    • Vital services (network equipment, mail servers, web servers, Oracle, FTS, LFCs, VOMS,…) were kept alive by ad hoc means)

      • Extensive use of virtual machines

    • Others services have been switched to partner sites

      • CIC Portal was hosted by CNAF during the shutdown and switched back to CC-IN2P3 afterwards

      • Failover procedure tested in real conditions

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Plans for 2007

Plans for 2007

  • Tier-1

    • Consolidate current grid services and integrate them into « normal » operations

      • Works towards the stability desired not only by the experiments but by the people operating the services

    • Increase network bandwidth with tier-2s and backup link to other tier-1s through FZK

    • Increase the rythm of the new machine room building project planned for 2009

  • Tier-2s/Tier-3s

    • Improve availability of the sites

    • Keep exercising the data transfer infrastructure

  • All

    • Make sure site administrators understand the ways data will be accessed (!)

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Fkppl france korea particle physics laboratory lia project

FKPPL (France Korea Particle Physics Laboratory) => LIA Project

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Conclusions

Conclusions

  • Participating sites are very motivated to contribute to this project…

    • … but it is harder than most of us expected

  • Ramp up plans of sites are rather aggressive

    • Several constraints don’t really make our life easier

  • Operating the grid services in their current status is complex and requires (highly competent and motivated) people

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


For more information

For more information

  • LCG-France website http://lcg.in2p3.fr

  • LCG-France T2-T3 Technical coordination wiki page:http://lcg.in2p3.fr/wiki/index.php/T2-T3

  • CC-IN2P3: http://cc.in2p3.fr

  • LCG-France Tier-1 resource planning

    • https://edms.in2p3.fr/document/I-004736

  • LCG-France Tier-2s resource planning

    • https://edms.in2p3.fr/document/I-008142

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


Aknowledgments

Aknowledgments

  • Thanks to the people that contributed material to this talk

    • Most of the slides are taken from Fabio Hernandez talk at WLCG Collaboration Workshop (CERN, January 22nd 2007)

    • Special thanks to K. Cho, Eric Lançon and Fairouz Malek

V. Breton, E. Lançon and F. Malek, ISGC symposium, March 27th 2007, Taipei


  • Login