1 / 15

The Virtual Data Toolkit

The Virtual Data Toolkit (VDT) is a comprehensive software package designed to facilitate grid computing. It includes essential grid software such as Globus and Condor-G, alongside virtual data tools like Chimera. The installation is made effortless with Pacman, which configures and installs the necessary components with minimal user intervention. Developed through strong collaboration between the Grid Physics Network (GriPhyN) and the International Virtual Data Grid Laboratory (IVDGL), the VDT is currently utilized by various institutions including USCMS and USAtlas, and is continuously updated to support user needs.

ruth-johnston
Download Presentation

The Virtual Data Toolkit

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Virtual Data Toolkit Alain Roy VDT

  2. What is the VDT? • A packaging of software • Grid software (Globus, Condor-G…) • Virtual data software (Chimera) • Utilities • An easy installation mechanism • Pacman: installs and configures it all • RPM: for some of the software VDT

  3. Who makes the VDT? • Grid Physics Network (GriPhyN) • Constructs the VDT • International Virtual Data Grid Laboratory (IVDGL) • Testing and hardening • Very tight collaboration between GriPhyN and IVDGL VDT

  4. Who makes the VDT? (2) • Core VDT Team: • Miron Livny: The boss • Alain Roy • Carey Kireyev • VDT Testing • Xin Zhao • Brian Moe • Pacman • Saul Youssef VDT

  5. Who uses the VDT? • GriPhyN collaborators • USCMS: In use today • USAtlas: In use today • LIGO: Will use soon • SDSS: Will use soon • European Data Grid (Including INFN) • Uses subset of software (patched) • Uses just RPMs • Strong collaboration and feedback • LCG VDT

  6. What exactly is in VDT? • VDT 1.1.8: • Globus 2.2.4 + advisories + patches • Condor & Condor-G 6.5.1 • MyProxy • Chimera/Pegasus • RLS • GLUE Schema • CA Certificates • Fault Tolerant Shell • EDG’s Make Gridmap • EDG’s CRL Update • ClassAds • Netlogger VDT

  7. Pacman Installation • Goal: • Type a single command • Everything downloads • Everything installs • Everything is configured • No questions asked • We’re close: • A few questions if you’re root • Basic configuration, may need changing VDT

  8. Pacman Installation (2) • Download Pacman • http://physics.bu.edu/~youssef/pacman/ • Install VDT • cd <install-directory> • pacman -get VDT-Server • pacman -get VDT-Client • ls condor/ globus/ post-install/ setup.sh edg/ gpt/ replica/ vdt/ ftsh/ perl/ setup.csh vdt-install.log • Use VDT

  9. Pacman post-installation • Post-install directory: • Notes on configuration choices made • Instructions for editing configuration • Configuration scripts: • Globus configuration (different from EDG) • Condor configuration VDT

  10. RPM Installation • Subset of whole VDT • Globus • Condor-G • Nice RPMs: • We repackage Globus • A dozen Globus RPMs, not hundreds • No configuration • No post-installation help VDT

  11. Testing • VDT team is building test suite • Interaction with LCG testing group • Working with NMI* to leverage: • NMI test suite • Stress testing • Application testing (CMS pipeline) • NMI test infrastructure • NMI = NSF Middleware Initiative • http://www.nsf-middleware.org VDT

  12. Support • Send us questions or problems • We will solve them if we can • We will interact with the developers, if necessary VDT

  13. Interaction with EDG/LCG • EDG and LCG get Globus and Condor-G RPMs from VDT • We do what we can to solve problems and get changes to Globus and Condor • We want to make a great package for EDG/LCG! VDT

  14. VDT’s Future • Access to new versions • Globus 3.0 • Extra VDT to help early adopters • Will not supplant main version for a while • Helping You • What can we do to make life easier for you? VDT

  15. Where do you learn more? • http://www.griphyn.org/vdt • Support: • vdt-support@ivdgl.org • Alain Roy: roy@cs.wisc.edu • Miron Livny: miron@cs.wisc.edu VDT

More Related