ilithya
Uploaded by
15 SLIDES
287 VIEWS
150LIKES

Overview of Condor and Grid Computing: Matchmaking, Scalability, and Credential Handling

DESCRIPTION

This document delves into the capabilities of Condor within grid computing environments. Key topics include supported grid types, matchmaking mechanisms, GlideIn functionality, credential handling, and scalability challenges. Additionally, it explores interactions with firewalls, monitoring, validation, and troubleshooting strategies. Various submission frameworks such as Pre-WS GRAM, OGSA GRAM, and NorduGrid are examined, alongside specific configurations for submitting jobs to Condor and other grid systems. This resource is essential for understanding effective grid resource management and job scheduling.

1 / 15

Download Presentation

Overview of Condor and Grid Computing: Matchmaking, Scalability, and Credential Handling

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Condor and Grids

  2. Potential Topics • Supported grid types • Matchmaking • GlideIn • Credential handling • Scalability • Firewalls • Monitoring & validation • Troubleshooting

  3. Potential Topics • Supported grid types • Matchmaking • GlideIn • Credential handling • Scalability • Firewalls • Monitoring & validation • Troubleshooting

  4. Pre-WS GRAM • Submit filegrid_resource = gt2 \ foo.edu/jobmanager-pbsglobus_rsl = (queue=long)\ (condor_submit=(universe java))

  5. OGSA GRAM • Submit filegrid_resource = gt3 http://foo.edu/\ ogsa/services/base/gram/\ PBSManagedJobFactoryServiceglobus_rsl = (queue=long)\ (condor_submit=(universe java)) • Museum mode

  6. WS GRAM • Submit filegrid_resource = gt4 foo.edu PBSglobus_xml = <queue>long</queue>

  7. NorduGrid • Submit filegrid_resource = nordugrid foo.edunordugrid_rsl = (queue=long)

  8. Unicore • Submit filegrid_resource = unicore usite.org vsitekeystore_file = keystorekeystore_passphrase_file = keystore.pwkeystore_alias = my cert

  9. Condor • Submit filegrid_resource = condor schedd.foo.edu \ cm.foo.eduremote_universe = java

  10. PBS • Submit filegrid_resource = pbs

  11. LSF • Submit filegrid_resource = lsf

  12. Matchmaking • Job Adgrid_resource = $$(ResourceName)requirements = TARGET.ResourceName \ =!= Undefinedrank = random()

  13. Matchmaking • Machine AdMyType = “Machine”TargetType = “Job”Name = “foo.edu”Machine = “foo.edu”ResourceName = “gt4 foo.edu PBS”UpdateSequenceNumber = 4Requirements = TARGET.JobUniverse == 9 && \ CurMatches < 10CurMatches = 0Rank = 0.0CurrentRank = 0.0WantAdRevaluate = True

  14. Matchmaking • Advertising a resourcecondor_advertise UPDATE_STARTD_AD \ ad-file • Call periodically • Use unix time for UpdateSequenceNumber

  15. MyProxy • Submit fileMyProxyHost = foo.edu:12345MyProxyServerDN = /DC=org/DC=doegrids…MyProxyCredentialName = proxy_fileMyProxyRefreshThreshold = 240 #minsMyProxyNewProxyLifetime = 12 #hrsMyProxyPassword = password • Or give password on command linecondor_submit -p password submit.desc

More Related