1 / 15

The Current Status of KorCAF and CDF Grid

The Current Status of KorCAF and CDF Grid. 양유철 , 장성현 , 미안 사비르 아메드 , 칸 아딜 , 모하메드 아즈말 , 공대정 , 김지은 , 서준석 , 김동희 ( 경북대학교 , 물리학과 ) 이영장 , 정지은 , 문창성 , 김현수 , 전은주 , 주경광 , 김수봉 ( 서울대학교 , 물리학과 ) 고정환 , 이재승 , 유인태 ( 성균관대학교 , 물리학과 ) 조기현 ( 슈퍼컴퓨팅 센터 , KISTI). Introduction to CDF Computing.

denali
Download Presentation

The Current Status of KorCAF and CDF Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Current Status of KorCAF and CDF Grid 양유철, 장성현, 미안 사비르 아메드, 칸 아딜, 모하메드 아즈말, 공대정, 김지은, 서준석, 김동희 (경북대학교, 물리학과)이영장, 정지은, 문창성, 김현수, 전은주, 주경광, 김수봉(서울대학교, 물리학과)고정환, 이재승, 유인태(성균관대학교, 물리학과)조기현(슈퍼컴퓨팅 센터, KISTI) KPS 2006 가을 EXCO ,대구

  2. Introduction to CDF Computing • Developed in 2001-2002 to respond to experiments greatly increased need for computational and data handling resources to deal with RunII • One of the first large-scale cluster approaches to user computing for general analysis. • Greatly increased CPU power & data to physicists. • CDF Grid via CAF, DCAF, SAM and SAMGrid ☞ DCAF(DeCentralized Analysis Farm) ☞ SAM (Sequential Access through Metadata) – Real data Handling System ☞ SAMGrid – combination of SAM and JIM (Job Information Management) system KPS 2006 가을 EXCO ,대구

  3. Outline KPS 2006 가을 EXCO ,대구

  4. Environment on CAF • All basic CDF software pre-installed on CAF • Authentication via Kerberos ☞ Jobs are run via mapped accounts with authentication of actual user through special principal ☞ Database, data handling remote usres ID passed on through lookup of actual user via special principal • User’s analysis environment comes over in tarball - no need to pre-register or submit only certain jobs. • Job returns results to user via secure ftp/rcp controlled by user script and principal KPS 2006 가을 EXCO ,대구

  5. Distributed clusters in Korea, Taiwan, Japan, Italy, Germany, Spain, UK, USA and Canada In 2006, about 50% of analysis farm outside of FNAL KPS 2006 가을 EXCO ,대구

  6. Current DCAF approach • Cluster technology (CAF = “Central analysis farm”) extended to remote site (DCAFs = Decentralized CDF analysis Farm) • Multiple batch systems supported : converting from FBSNG system to Condor on all DCAFs • SAM data handling system required for offsite DCAFs KPS 2006 가을 EXCO ,대구

  7. Current CDF Dedicated Resources http://www-cdf.fnal.gov/internal/fastnavigator/fastnavigator.html (2006/Aug) KPS 2006 가을 EXCO ,대구

  8. Detail of KorCAF resources KPS 2006 가을 EXCO ,대구

  9. Storage status • cdfsoft Installed products : 4.11.1, 4.11.2, 4.8.4, 4.9.1, 4.9.1hpt3, 5.2.0, 5.3.0, 5.3.1, 5.3.3, 5.3.3_nt, 5.3.4, development Installed binary products: 4.11.2, 5.3.1, 5.3.3, 5.3.3_nt, 5.3.4 Working on CondorCAF batch system KPS 2006 가을 EXCO ,대구

  10. CAF gui & Monitoring System Select farm Data access Process type Submit status User script , I/O file location http://cluster46.knu.ac.kr/condorcaf KPS 2006 가을 EXCO ,대구

  11. Grid Functionality for User (KorCAF) KPS 2006 가을 EXCO ,대구

  12. Total CDF Computing Requirements • Analysis CPU, disk, tape needs scale with number of events. • FNAL portion of analysis CPU assumed at roughly 50% beyond 2005. KPS 2006 가을 EXCO ,대구

  13. Movement to Grid • It’s the world wide trend for HEP experiment. • Need to take advantage of global innovations and resources. • CDF still has a lot of data to be analyzed. Cannot continue to expand dedicate resource USE Grid KPS 2006 가을 EXCO ,대구

  14. Activities for CDF Grid • Testing various approaches to using Grid resources (Grid3/OSG and LCG) • Adapt the CAF infrastructure to run on top of the Grid using Condor glide-ins (GlideCAF) • Use direct submission via CAF interface to OSG and LCG • Use SAMGrid/JIM sendboxing as an alternate way to deliver experiment + user software • Combine DCAFs with Grid resources KPS 2006 가을 EXCO ,대구

  15. Conclusions • CDF has successfully deployed a global computing environment (DCAFs) for user analysis. • A large portion (50%) of the total CPU resources of the experiment are now provided by offsite through a combination of DCAFs and other clusters. • And KorCAF (DCAF in Korea) working on Condor batch system. • Active work is in progress to build bridges to true Grid methods & protocols provide a path to the future. KPS 2006 가을 EXCO ,대구

More Related