1 / 17

Status of analysis & MC farms

Status of analysis & MC farms. Concezio Bozzi INFN Ferrara. 30/08/2002. Three farms in Italy today: “MC”: for official Simulation Production (formerly at Caspur, now at INFN Rome) “Analysis”: a Tier B with Kanga data located at Caspur (Rome)

Download Presentation

Status of analysis & MC farms

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Status of analysis & MC farms Concezio Bozzi INFN Ferrara 30/08/2002

  2. Three farms in Italy today: “MC”: for official Simulation Production (formerly at Caspur, now at INFN Rome) “Analysis”: a Tier B with Kanga data located at Caspur (Rome) “Repro”: located in Padova, will reprocess all Babar Run1+Run2 data starting this summer The name of the game Concezio Bozzi (Ferrara)

  3. MonteCarlo Farm Today Upgrade Analysis Farm Today - Upgrade INFN Farms in Rome MonteCarlo Farm has been moved June 15th from Caspur to INFN (Rome) The Analysis Farm is still at Caspur Concezio Bozzi (Ferrara)

  4. MonteCarlo Farm today • 1 server Linux, dual cpu, PIII 800 MHz, 512 MB • (NFS and lock servers, batch queues, MocaEspresso) • 14 Linux clients, dual cpu, PIII 800 MHz, 768 MB • 2 Array RAID EIDE : 2x0,5 = 1 TB • Event rate: 3.5 M events/month 30 M events in 1 year Concezio Bozzi (Ferrara)

  5. MonteCarlo Farm: jobs

  6. Farm MonteCarlo: comparisons … Concezio Bozzi (Ferrara)

  7. Farm MonteCarlo: comparisons … 19.4 M events from August 15th 2001 to June 15th 2002 Concezio Bozzi (Ferrara)

  8. Farm MonteCarlo: comparisons … we are here !

  9. MonteCarlo Farm: CPU SCSI problems stop/start production re-validation Concezio Bozzi (Ferrara)

  10. MonteCarlo Farm: disk & net Concezio Bozzi (Ferrara)

  11. MonteCarlo Farm: Upgrades • 2002: increase production to 6-8 Mevents/month • clone Linux farm • 17 2-CPUs, 1.26GHz, 1 GB RAM: installing now • Server and disk (1TB) ordered • use Analysis farm resources when available • Problems with a Sun disk (1TB), recovering… • 2003: increase production to 20 M events/month • more CPUs (150*30SpecInt95 ~ 35 1.6GHz 2xCPUs) • use repro farm whenever possible Concezio Bozzi (Ferrara)

  12. Analysis Farm: Today • 5 Sun E450, 4x400 MHz, 2GB (NFS data server) • 15 Linux clients, dual cpu, PIII 1 GHz, 1 GB: • 1 Sun Ultra 10: lock server - 1 Sun Ultra 10: monitoring (to be dismissed soon) • Disk space: 9 TB for Kanga • Data: AllEvents + 8 streams. The complete (99-02) dataset is available • MC: ~650M events available • Private & Toy MC • SP MC production as “infn2” (lower priority wrt analysis) Concezio Bozzi (Ferrara)

  13. Analysis Farm: users SUN Linux Concezio Bozzi (Ferrara)

  14. Analysis Farm: jobs CPU efficiency Running jobs Linux Pending jobs Concezio Bozzi (Ferrara)

  15. Analysis farm: Upgrade 2002: • 17 Linux clients, dual cpu (in hand) • 3TB disk space (ordered): 15TB total This will be enough until March 2003 2003: • cpu power x3: 210 30SpecInts95 (50 1.6GHz 2xCPUs) • Disk: from Padova (?) • maintain Kanga until end of reprocessing, (spring 03) • Next: Computing Model Working Group OBJY vs. non-OBJY Event Store, MINI vs. MICRO, etc… Concezio Bozzi (Ferrara)

  16. Babar-Grid • Some activity going on in Italy • Define and implement a Grid-scheme for MC production • Installing/testing on the INFN-Grid Ferrara testbed Concezio Bozzi (Ferrara)

  17. Farmers …. • Ferrara: D. Andreotti, V. Azzolini, C. Bozzi, E. Luppi + CS students • Padova: A. Ceseracciu, A. Crescente, A. Dorigo, F. Galeazzi, M. Marzolla, M. Morandin, R. Stroili, G. Tiozzo, G. Vedovato • Rome: C. Bulfon, F. Safai Tehrani • Trieste: G. Della Ricca Concezio Bozzi (Ferrara)

More Related