1 / 15

Progress Update on Belle MC Production via Grid - Soft/Comp Session, March 17, 2009

This document presents an overview of the second open meeting of the SuperKEKB collaboration, focusing on the Belle MC production status using Grid resources. Highlights include the resumption of production after a long downtime, updates on new operational sites, as well as the challenges faced with job processing and high-level storage management (HSM). It outlines detailed procedures for job management using Ganga, a user-friendly frontend for Grid job definition and management. The meeting emphasizes the integration of various resources for effective Monte Carlo (MC) production.

afram
Download Presentation

Progress Update on Belle MC Production via Grid - Soft/Comp Session, March 17, 2009

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Belle MC Production on Grid 2nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University

  2. Contents • Status of MC production • Belle MC production procedure with Grid • Ganga Belle MC with Grid

  3. MC Production Status • Long down time since last June • Just resumed • New sites • KISTI, Melbourne, Ljubljana, Karlsruhe Belle MC with Grid

  4. Belle VO sites Belle MC with Grid

  5. One Week Statistics Belle MC with Grid

  6. Problems • Storage, HSM busy • Stays inside B system and shared with Belle users • Access to HSM sometimes concentrate on one of four server • Job processing time exceed limits Belle MC with Grid

  7. Belle MC Procedure1. Get Assignment from Web • 4 physics modes (charged, mixed, charm, uds) • 1 slot = 100 run range • Same number of events with experiment data • 10 set (streams) Belle MC with Grid

  8. Belle MC Procedure2. Receive a mail Gen and Bkg files: copy to HSM (in B computer system) and register to SRB “Sregister hoge.pgen srbdir” Generator, Bkg, sh script files are provided by MC manager SRB (Storage Resource Broker) Accessible to/from Grid UI (User Interface) Server you work for Grid Copy script.tgz to UI Belle MC with Grid

  9. Belle MC Procedure3. Submit jobs JDL Executable=Job.sh Stdout=log.out Stderr=log.err • Create a directory for the slot (prepare-job.rb) • Modify sh script and create JDL files (basf2grid.sh) • Add “copy inputs from SRB” and “copy outputs to SRB” • Create a sh script to submit (mksubmit.rb) • “edg-job-submit … job.jdl” • Submit (submit) Belle MC with Grid

  10. Belle MC Procedure4. Monitor running jobs Summary CPU Elapse time Belle MC with Grid

  11. Belle MC Procedure5. Retrieve finished job • Retrieve log files of finished jobs • Checking the job is correctly completed Belle MC with Grid

  12. Ganga http://ganga.web.cern.ch/ganga/index.php • Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It has been developed to meet the needs of the ATLAS and LHCb for a Grid user interface, and includes built-in support for configuring and running applications based on the Gaudi / Athena framework common to the two experiments. Ganga allows trivial switching between testing on a local batch system and large-scale processing on Grid resources. Belle MC with Grid

  13. Ganga “Hello World” • Configure with Job() • Directories • JDL file • Backend = local Configuration Submit Status Belle MC with Grid

  14. Ganga MC Production Backend=LCG → edg-job-submit Belle MC with Grid

  15. Summary • MC Production resumed !! • New sites working correctly with large resouces • Configuration and Job submission tool “Ganga” tried. • Easy to see what we’re doing • Good to unified interface • No convenience about functionality We must write script for scripts, anyway. Belle MC with Grid

More Related