1 / 16

and

and. Alexandre Duarte OurGrid/EELA Interoperability Meeting Campina Grande, 31.08.2006. Interoperability. Port OurGrid applications to EELA/gLite Port gLite applications to OurGrid Use OurGrid resources to execute jobs submitted to EELA

lisle
Download Presentation

and

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. and Alexandre Duarte OurGrid/EELA Interoperability Meeting Campina Grande, 31.08.2006 www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  2. Interoperability • Port OurGrid applications to EELA/gLite • Port gLite applications to OurGrid • Use OurGrid resources to execute jobs submitted to EELA • Use EELA resources to execute jobs submitted to OurGrid www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  3. EELA Infrastructure www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  4. Current Status www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  5. Application Porting www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  6. Port OurGrid Applications to EELA/gLite • The OurGrid JDFs are written using a “subset” of the gLite Job Description Language • We just need to write a simple translator from OurGrid JDF to a gLite JDL describing a Job Collection • Each OurGrid task will be a Job in a gLite job Collection • The Input and Output sandboxes will mention only local files • May need a dictonary to translate job requirements www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  7. Port EELA/gLite applications to OurGrid • Two main aspects to consider: • How to deal with DAG jobs ? • How to process input and output sandboxes • Build a Job Submitter able to: • Convert the gLite JDL to a OurGrid JDF • Translating all filenames in input and output sandboxes into local file names • May need a dictionary to translate job requirements • In the case of a DAG it have to create one JDFs for each Node • Download all non-local files in the input sandbox to the local file system • Submit the Job(s) to MyGrid following (if present) the DAG • Upload all non-local files in the output sandbox to their target location www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  8. Use OurGrid resources to execute jobs submitted to EELA www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  9. Job Submission Reviewed www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  10. WN Computing Element • Accepts batch jobs (and job control requests) through a gatekeeper • Performs the necessary AAA operations and map to a local user • Passes the job to a layer that interacts with the local resource manager • BLAH • Monitors the status of the jobs and reports it to the client Client Grid Computing Element Monitoring Site AAA and local mapping Job Controller LRMS www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  11. BLAH • The BLAHP (Batch Local ASCII Helper Protocol) provides a set of plain ASCII commands to manage jobs on the batch systems. • Batch system interactions • Not part of the daemon's core. • Performed via external scripts with a common syntax among different batch systems. • Three scripts for every batch system: • xxx_submit • xxx_status • xxx_cancel • The effort for batch system abstraction is concentrated in these scripts. • Adding support for new batch systems requires “only” to write a new set of scripts. www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  12. Proposed Solution Client • Create a plugin for BLAH that can interact with MyGrid using it as a LRMS • Problems: • Can we really consider MyGrid a LRMS? • There are some strong assumptions on batch systems: • “There must be a way to dispatch files to running jobs.” Grid Computing Element Monitoring Site AAA and local mapping Job Controller MyGrid BLAH Plugin OurGrid Peer www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  13. Use EELA resources to execute jobs submitted to OurGrid www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  14. OurGrid Archictecture www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  15. Proposed Solution MyGrid X.509 1 gLite Peer 6 2 OurGrid Workers Workload Manager Computing Element Computing Element 5 3 WorkerNodes Computing Element Computing Element 4 Computing Element www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

  16. I think that we may have answered the What. Now we need to answer Who and When. www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

More Related