1 / 17

What’s New in Condor

What’s New in Condor. Condor & INFN. Feedback from INFN users has been very useful and has given us new features Bologna Batch System & new policies I will be in Bologna, helping with Condor, June 16-July 11. Condor Development Process. We maintain two different releases at all times

hao
Download Presentation

What’s New in Condor

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. What’s New in Condor

  2. Condor & INFN • Feedback from INFN users has been very useful and has given us new features • Bologna Batch System & new policies • I will be in Bologna, helping with Condor, June 16-July 11

  3. Condor Development Process • We maintain two different releases at all times • Stable Series • Second digit is even: e.g. 6.2.2, 6.4.7, 6.6.0 • Development Series • Second digit is odd: e.g. 6.3.1, 6.5.2

  4. Stable Series • Heavily tested • Runs on our production pool of nearly 1,000 CPUs • No new features, only bugfixes, are allowed into a stable series • A given stable release is alwayscompatible with other releases fromthe same series • 6.4.X is compatible with 6.4.Y • Recommended for production pools

  5. Development Series • Less heavily tested • New features are added frequently • Compatibility in series is not guaranteed

  6. Computing on Demand • Run executable now • Suspends job while running • Useful for short-running important work

  7. Improved Negotiation • The condor_schedd (the job queue manager) sends “classes” of jobs for matching • Previously, jobs were sent one at a time. • 1000 similar jobs will take the same time to negotiate as one job

  8. Smarter File Transfer • New file transfer mechanism: • IF_NEEDED : will automatically transfer the files if the submit and execute machine do not share file system • Users used to have to decide

  9. Better Security • GSI (X.509 Certificates) implementation more complete and customizable • Each Condor daemon can have its own certificate • You can run a “Personal Condor” with your user proxy • Easier configuration • Particularly if you already use Globus • Improved error messages

  10. Central Manager • Redundant central managers allowed • If the main central manager goes down, you may still run administrative commands • Central manager daemons can now run on any port • Can use TCP instead of UDP

  11. Avoiding Black Holes • Condor can keep track of the last few resource matches • This can be used to prefer the same machine if restarted • Can also be used to avoid a machine if restarted, which is a first step towards avoiding “Black Holes”

  12. New Installer • For UNIX • Version 6.6.0 will be available as RPMs • Command line options specify the installation parameters, and no questions are asked • Easier to automate • For Windows • Based on MSI (Microsoft Software Installer) • Batch Install option

  13. ClassAds • ClassAd attributes can be linked to external functions • Rank = complex_function(TARGET.Owner)

  14. New Features in DAGMan • Each job can now have it’s own log file • XML userlogs • Can produce pretty graphs

  15. Condor for Windows • Ability to run scheduler universe jobs • DAGMan now works on Windows • JAVA universe support • Better error management • Ability to use CHIRP (Remote I/O)

  16. Improvements in Windows (cont) • Support for: • Windows XP • Foreign Language versions of Windows • Legacy 16-bit app • Improved Windows-to-UNIX job submission and vice versa. • BirdWatcher, a system tray icon which gives basic status and control of Condor

  17. More information • Information: www.cs.wisc.edu/condor • Support: condor-admin@cs.wisc.edu • Ask me questions!

More Related