1 / 11

Status of Tier-1 @ GSDC, KISTI

Status of Tier-1 @ GSDC, KISTI. Sang-Un Ahn , for the GSDC Tier-1 Team sahn@kisti.re.kr. GSDC Tier-1 Team. News. Nov. 2012: EMI-2 middleware migration done End of support to gLite 3.2: decommissioned by 30 Nov 2012 End of support to EMI-1: decommissioned by 30 Apr 2013

Download Presentation

Status of Tier-1 @ GSDC, KISTI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Status of Tier-1 @ GSDC, KISTI Sang-Un Ahn, for the GSDC Tier-1 Team sahn@kisti.re.kr

  2. GSDC Tier-1 Team 13th CERN-Korea Committee

  3. News • Nov. 2012: EMI-2 middleware migration done • End of support to gLite 3.2: decommissioned by 30 Nov 2012 • End of support to EMI-1: decommissioned by 30 Apr 2013 • OS upgrade: Scientific Linux 6 • Some component, e.g. VOBOX, is still glite-3.2 and remaining on SL5 (In a few weeks, new release will be deployed) • Dec. 2012: Tape system installation complete • IBM TS3500 • Dual Caches: Xrootd, GPFS (High Availability) • Mar. 2013: start of p-Pb collision data migration to KISTI • 310 TB with 400k files 13th CERN-Korea Committee

  4. Resource • 1512 cores (63 WNs * 24 cores) with 3GB memory/core • 1 PB Disk space • Old SE(100TB) will be decommissioned(test-bed, maintenance difficulties) • Migration is on-going (to ALICE::KISTI_GSDC::SE2): ~60% done • 1 PB Tape space for data archiving • 8 tape drives (total 2GB/s throughput) with 260 media (4 TB per medium) • For cache, • 200 TB xrootd pool • 275 TB GPFS pool 13th CERN-Korea Committee

  5. Operation • Concurrent job capacity: 1512 • Last 3 months average: 1328 (~ 88% of job capacity) • Requirement: 85% of job capacity at least for 2 months • Announced shutdown for maintenance, no critical outage • Correlation with production/user job activities, central services • Mass MC production/reconstruction, Holidays, Weekends Backbone Network Maintenance 13th CERN-Korea Committee

  6. Site Availability/Reliability • WLCG SAM project: • Service Availability Monitoring framework • Dispatch probes corresponding each service (CE, SE, WN, etc.) • Target: 97% • Definition: • Monthly report by WLCG for VOs • OPS, ALICE, ATLAS, CMS, LHCb … • Since Feb 2013, ALICE probe has been dispatched to KISTI • Requirement: Running of the reliability tests (both OPS and ALICE-specific) and publishing those to the new SAM infrastructure 13th CERN-Korea Committee

  7. 2013 p-Pb RAW replication • p-Pb data transfer started on 7th March • Passed periodic functional test by ALICE (100% availability after tape configuration) • Requirement: 90% Storage Element availability (functional tests) for at least 2 months • Total data size: 309.9 TB (400k files are in queue) • 39runs done + 8 runs running out of 177 runs (14th Apr) : ~100k files w/ 80 TB (26% of tatal) • Optimization of the policy (migrate/purge) for xrootd and GPFS is in progress • Transfer speed: 24MB/s on average, 379MB/s on peak • Requirement: High speed transfer of data from CERN to KISTI at the speed required to receive and archive 10% of the ALICE AA raw data foreseen for 2012 over a continuous period of 2 weeks • Effort to improve the network performance in on-going together with KISTI network expert 30MB/s 20MB/s 11 Apr 2013 03 Mar 2013 13th CERN-Korea Committee

  8. Network • Currently 1Gbps (dedicated) bandwidth between CERN-KISTI is now being fully used • Requirement: 3Gbps or higher bandwidth to join LHC OPN • In May 2013, dedicated 2Gbps link will be deployed: • Connection: GLORIAD-KR – NLR* - SURFnet - CERN • Before: (1Gbps) GLORIAD-KR – CAnet, CANARIE – SURFnet - CERN • With 2Gbps, discussion among network experts (KISTI-CERN) to join LHC OPN will soon be started * National LambdaRail(U.S.) 13th CERN-Korea Committee

  9. Pledged • Pledged resources • Based on WLCG & ALICE CollaborationMoU • Meeting ALICE requirement by 2013 13th CERN-Korea Committee

  10. Milestones (Summary of Requirements) • Remaining requirements: plans for • Improving network bandwidth/performance and joining LHC OPN • Establishing a system to support Tier-1 services in 24/7 13th CERN-Korea Committee

  11. Conclusion • KISTI-GSDC has been demonstrating WLCG Tier-1 for ALICE experiment following the proposed plan • Full sets of p-Pb collision data is being replicated to KISTI tape storage • Heavy activities to reconstruct them are foreseen as well as that of exploiting them • In May, dedicated 2Gbps bandwidthwill be establishedbetween CERN and KISTI, and discussion to join OPN will be started • Target date for qualification of Tier-1: Oct. 2013 (the next WLCG Overview Board) 13th CERN-Korea Committee

More Related