1 / 16

Prof. David Britton GridPP Project leader University of Glasgow

Efficient & Effective. Prof. David Britton GridPP Project leader University of Glasgow. GridPP26 Collaboration Meeting 29 th March 2011. Outline. Where are we? A brief look back The theme of this meeting A brief look forward. Where are we?.

kail
Download Presentation

Prof. David Britton GridPP Project leader University of Glasgow

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Efficient & Effective Prof. David BrittonGridPP Project leader University of Glasgow GridPP26 Collaboration Meeting 29th March 2011 IET, Oct 09

  2. Outline • Where are we? • A brief look back • The theme of this meeting • A brief look forward GridPP26

  3. Where are we? During GridPP3, the CPU delivered by the UK grew a factor of 10. --------- GridPP3 --------- GridPP2+ ------------- GridPP4 ----------- --------- GridPP2 --------- --------- GridPP1 --------- 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 From Web to Grid From Prototype to Production From Production to Exploitation Computing in the LHC era Seneca: "Every new beginning comes from some other beginning's end." GridPP26

  4. Observations on GridPP3 Data Taking GridPP3 Data Taking GridPP26

  5. Observations on GridPP3 85% During GridPP3, the UK was the largest EGEE contributor of CPU to the LHC VOs But, we have struggled to get CPU efficiency (CPU/Wall time) consistently above 85%. Many factors here. GridPP26

  6. Observations on GridPP3 HW-£ LHC OPN CASTOR SSC R89 Disk CSR Disk … but I doubt the fates are out of ammo yet! We dodged a lot of bullets… GridPP26

  7. Efficient & Effective Getting some exercise whilst putting the baby to sleep and walking the dog: Efficient and effective! …. But clearly one needs to do choose effective things to do efficiently! GridPP26

  8. Efficient & Effective Efficiency is more about speed or quantity. Effectiveness is more about quality. 100% Help-desk operation Effectiveness: Fraction of tickets assigned to correct expert Efficiency: Number of tickets assigned/day. GridPP26

  9. Meetings? Since the beginning: 16 OC meetings 16 CB meetings 30 UB/EB meetings 420 PMB meetings 776 UK-ROC (inc dTeam) GridPP26

  10. GridPP4 Structure Oversight Committee changes from bi-annual to a mid-term and full-term review. The CB stays the same: Group leaders from each institute. User Board becomes entirely virtual with a User Coordinator responsible for resource scheduling and community contact. The PMB stays largely the same. The dTeam becomes the ops-Team and is re-aligned with new Tier-2 structure and the development of a UK NGI. GridPP26

  11. Tier-2 Structure Evolve from 4 x Tier-2 coordinators plus 4 x deputies (the latter did not broaden the site representation) to 8 people from the key sites (as identified by the experiments) plus EGI representatives. Goal is to better align ops-team with the experiments and with EGI/NGI. It also ensures engagement in the national operations of all sites in which significant manpower has been invested. Tier-2s may decide to keep much of their internal coordination as is. GridPP26

  12. GridPP4 Funding GridPP4 award is now approved for the full four years (April 2011 to March 2015) with the exception of the Tier-2 hardware funding. We are clarifying with STFC that we buy a service from the Tier-2s, thus this funding should probably not (all) be classified as “capital”. This may help to secure approval. The first-tranche of GridPP4 grants came in about 2.5% higher than planned. We need to save this money on the second-tranche (reduction of 1-month? per post). To facilitate this, we will arrange for no-cost extensions of the first-tranche grants to provide a 6-month overlap. We probably don’t want to rush to issue the new grants just yet due to the new grants system. GridPP26

  13. Elephant #1 Current Estimates: Disk+CPU £3.5m at Tier-1 £3.3m at Tier-2 GridPP4 Proposal: Disk+CPU: £2.8m at Tier-1; £2.7m at Tier-2 GridPP26

  14. Elephant #2 Manage with 2011 Shift from 2013 to 2012 Big increase for LHCb Shift towards Tier-2s GridPP26

  15. Whither to? • Towards simplicity. • Less demands on custodial disk storage: • storage-free Tier-2s? • commercial solutions (W1R0)? • virtual data? • More commonality: • ARC, gLite, Unicore: EMI? • Experiment proprietary solutions. • Virtualisation. • Taming the Ogres: • CASTOR (and beyond) • Data Bases • Tape Systems • Exploiting the new: • More network-centric architectures? • New computational architectures? • Future storage concepts? • Economically viable commercial offerings? GridPP26

  16. Summary • In GridPP4, driven by the increasing demands from LHC data, we need to strive towards greater efficiency and effectiveness. This is the underlying theme of the meeting. • It is important because in the next few years we are likely to experience for the first time, real and sustained contention for resources. This will be against a backdrop of financial austerity, higher-than-planned hardware prices, and increased experiment resource requests. • We need to remain focused on the, sometimes changing, needs of the experiments. It will take agility, good-humour, cooperation, innovation, anticipation, hard-work, some deep-breaths, (and so on)... • This meeting marks the end (of GridPP3) and the beginning (of GridPP4). It is an opportunity to share in our past successes and refine our vision of the future. GridPP26

More Related