1 / 25

CERN Computer Centre Upgrade Project

CERN Computer Centre Upgrade Project. Wayne Salter HEPiX November 2010. Overview. Current status of CERN Computer Centre (CC) Layout, powering and cooling Current issues and anomalies Aims of the upgrade project Proposed project Layout, powering and cooling Project schedule and status

miya
Download Presentation

CERN Computer Centre Upgrade Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CERN Computer Centre Upgrade Project Wayne Salter HEPiX November 2010

  2. Overview • Current status of CERN Computer Centre (CC) • Layout, powering and cooling • Current issues and anomalies • Aims of the upgrade project • Proposed project • Layout, powering and cooling • Project schedule and status • Summary CERN Computer Centre Upgrade Project - HEPiX November 2010 - 2

  3. CERN Computer Centre Overview • Designed and built in early 1970s • Fully refurbished around 2000 • Increased power and improved cooling • Nominal current capacity: 2.5MW (including 240kW of critical power) • Extended (usable) capacity: 2.9MW (including 340kW of critical power) forfeiting redundancy for all UPS systems • On-going project to: • Increase the nominal capacity to 3.5MW/600kW with N+1 redundancy • Address some issues/anomalies CERN Computer Centre Upgrade Project - HEPiX November 2010 - 3

  4. Main Computer Room CERN Computer Centre Upgrade Project - HEPiX November 2010 - 4

  5. Cold aisle is cold! CERN Computer Centre Upgrade Project - HEPiX November 2010 - 5

  6. Current Status of CERN CC • Main computer room (1600m²) • Air cooled racks • ~1.9MW • ‘Vault’ (1400m²) • Mixture of air cooled and water cooled racks + tape robots • ~640kW • Room for back up data in separate building (200m²) • Mainly tape robots with air cooling • ~ 30kW • Two Telecoms rooms • CERN Internet Exchange Point (CIXP) ~ 10kW • Two types of equipment both on UPS • Physics with a single power feed but no diesel backup • Critical with dual power feeds and diesel backup CERN Computer Centre Upgrade Project - HEPiX November 2010 - 6

  7. Power and Cooling • 3 physics UPS, each with 4*400kvA modules + 1 critical UPS with 2*300kVA modules • Air cooled installations: • IT & Telecoms equipment (capacity up to ~2.5MW), technical areas (mainly UPS rooms)... and offices • (3+1) Chillers not secured by UPS nor diesel • Pumps and AHUs secured by diesel but not UPS • Water-tank for stored cooling capacity (a few mins) • Water cooled installations: • For IT (physics) equipment (capacity up to 800kW) • (1+1) Chillers not secured by UPS nor diesel • Pumps secured by (physics) UPS • Water-tank for stored cooling capacity (~10 mins) CERN Computer Centre Upgrade Project - HEPiX November 2010 - 7

  8. Current Issues and Anomalies • Cooling for critical UPS room insufficient • Mixing of critical and physics equipment • Location and cooling • No cooling of CC when running on UPS and insufficient stored cooling capacity when on diesel • Insufficient critical power available • Approaching the limit of available power for the building • No redundancy for critical UPS • Usage of full ‘available’ 2.9MW implies loss of redundancy for physics UPS • A/C of CC coupled to adjacent office building CERN Computer Centre Upgrade Project - HEPiX November 2010 - 8

  9. Current Power Situation Normal Network 2.9MW Diesel Generator (N+1) Critical UPS (2) Physics UPS (4*) 2.56MW 340kW 340kW IT Physics Equipment IT Critical Equipment *N+1 redundancy sacrificed to achieve 2.9MW CERN Computer Centre Upgrade Project - HEPiX November 2010 - 9

  10. Main Computer Room CERN Computer Centre Upgrade Project - HEPiX November 2010 - 10

  11. Vault CERN Computer Centre Upgrade Project - HEPiX November 2010 - 11

  12. Backup Building CERN Computer Centre Upgrade Project - HEPiX November 2010 - 12

  13. Primary Goals of the Upgrade Project • Solve the cooling issue for the critical UPS room • New UPS systems in a different location • Increase critical UPS capacity to 600kW • Increase overall power capacity to 3.5MW • Restore N+1 redundancy for both critical and physics UPS systems • Secure cooling for critical equipment when running on UPS and extend stored cooling capacity for physics when on diesel • Decouple the A/C for CC from the adjacent office building CERN Computer Centre Upgrade Project - HEPiX November 2010 - 13

  14. Power Requirements Normal Network 3.5MW Diesel Generator (N+1) Critical UPS (3+1) Physics UPS (4+1) 2.9MW 600kW 600kW IT Physics Equipment IT Critical Equipment Cooling for IT Critical Equipment CERN Computer Centre Upgrade Project - HEPiX November 2010 - 14

  15. Approach • Barn area of CC building to be converted to house: • 3 Electrical rooms • An IT room with water cooled racks to house critical equipment (up to 450kW) • New ventilation systems for the critical area of the main computer room • New ventilation systems for the Telecoms rooms will be installed in adjacent offices • A new partially sunken building for additional chillers and a storage tank for the cooling of the critical areas • An additional storage tank for extending the stored cooling capacity for physics equipment CERN Computer Centre Upgrade Project - HEPiX November 2010 - 15

  16. Areas Affected New CV room Two new transformers Reduced Critical Area Telecoms Rooms Barn New AHUs Future expansion for Telecoms Rooms New AHUs Presentation Title - 16

  17. Layout - I CERN Computer Centre Upgrade Project - HEPiX November 2010 - 17

  18. Layout - II CERN Computer Centre Upgrade Project - HEPiX November 2010 - 18

  19. Layout - III CERN Computer Centre Upgrade Project - HEPiX November 2010 - 19

  20. Layout - IV CERN Computer Centre Upgrade Project - HEPiX November 2010 - 20

  21. Layout - V CERN Computer Centre Upgrade Project - HEPiX November 2010 - 21

  22. Layout - VI CERN Computer Centre Upgrade Project - HEPiX November 2010 - 22

  23. Layout - VII CERN Computer Centre Upgrade Project - HEPiX November 2010 - 23

  24. Schedule and Status • All Market Surveys already launched • RFPs in process of being released • ‘Barn’ cleared of IT equipment end of October • ‘Barn’ to be cleared of electrical and other installations end of 2010 • Adjudication of contracts at March FC • CE works to be completed July 2011 • EL+CV installations Aug/2011-May/2012 • Increased physics power available March 2012 and increased critical power June 2012 CERN Computer Centre Upgrade Project - HEPiX November 2010 - 24

  25. Summary • CERN CC was not designed for today’s IT equipment • Major upgrade already performed in 2000 • Further upgrade in progress: • To maximize the capacity of the CC • To resolve some outstanding issues • Increased capacity to be available mid-2012 • Last increase in capacity foreseen with today’s technology • Other solutions will be required for any future increases in required computing capacity CERN Computer Centre Upgrade Project - HEPiX November 2010 - 25

More Related