1 / 4

USQCD Grid Implementation

Balint Joo ILDG 11. USQCD Grid Implementation. Same as last time but more stable. Metadata Catalogue at JLab Back End: using eXist version 1.0 XML Database, Service: Axis Web ILDG-MDC Service File Catalogue at Jlab Back End: Python Script remaps LFNs to SURLs

erwin
Download Presentation

USQCD Grid Implementation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Balint Joo ILDG 11 USQCD Grid Implementation

  2. Same as last time but more stable... • Metadata Catalogue at JLab • Back End: using eXist version 1.0 XML Database, • Service: Axis Web ILDG-MDC Service • File Catalogue at Jlab • Back End: Python Script remaps LFNs to SURLs • Service: Java FC Web Service from LDG, no delegation • Storage Element at Fermilab • Fermilab Public D-Cache, Read only to ILDG VO members, R/W to users with FNAL Kerberos principal • VO Based Authorization using gPlazma • Service: SRM v2.1 + GridFTP transfers • ILDG Wiki to move to Australia • For technical simplicity, maintain www.lqcd.org at Jlab • Jump pad to ILDG Wiki, Schemata & static pages.

  3. Future Plans • Near Term (forthcoming few months)‏ • (Double) Store Existing Data Sets in Fermilab dCache • currently in progress... • SCP is too slow so... • Efficient, high bandwidth file transfers between Fermilab, Jlab and ORNL folding in Argonne • This is to facilitate existing and forthcoming multi site projects, assuming we get further INCITE time. • Also, this will help efficient archival and use of ILDG • Longer Term (next year and beyond)‏ • Deployment of SRM&GridFTP enabled storage element at Jlab. • Deploy rather than develop – use GT 4 now that it is more commoditized

  4. Personal Thoughts • I am very impressed by the ease of installation of LDG client tools. It is no longer so daunting to install standard clients • I think this will lead to new demands in the U.S. that we'll need to meet. • Until recently, I thought scp is sufficient to transfer data • Experience with ORNL data production made me change my mind. • GridFTP seems more standard than bbcp or bbftp these days, so I will be pushing for these tools to be deployed if I can. Thanks to LDG, client deployment at least, is simple. • I expect a marked jump in ILDG use in the U.S. lattice community next year.

More Related