Donnerstag August 11, 2005

N1GE 6 - Scheduler Hacks: consumables as load threshold

This feature is new to N1GE 6 and can be quite powerful, if used correctly. One could model similar behavior earlier with custom load sensors and load adjustments but this is now much more reaktive, build in and easier to use. One could also find similarities to the subordinate queues. However, this solution is much more generic. It takes any consumable while the subordinate queues are fixed on slots.

To use this feature one has to create a consumable, assign it to a host or the global host and pick a queue which should be in alarm state, when a certain amount is consumed. Assuming that one assigns 5 licenses to a host, and the queue instance should go into alarm state, when 2 licenses are consumed, one would set:

>qconf -mc
licence lic int <= YES YES 0 0

>qconf -me test_host
complex_values lic = 4

>qconf -mq test.q
load_thresholds lic = 3

This is all that is needed. If now two jobs requesting lic are running on the all.q on the test_host, the test.q will go into alarm state and no further jobs will be started in that queue.

As one can see, this allows very complicated scenarios and a new way of handling job priorities and subordinating queues independly of the number of used slots.

Important:
An important difference is the possible definition of the consumable with is used as a load_threshold on queue level. This is not possible with load values.

I am sure it will take a while to play with this feature before useful scenarios are obvious.

( Aug 11 2005, 01:34:34 PM CEST ) Permalink Kommentare [1]

N1GE 6 u6 is available Grid Engine 6.0 Update 6 is now ready and courtesy binaries are
available for download. The SGE 6.0u6 release fixes bugs of the
software, installation procedure and man pages.

   http://gridengine.sunsource.net/project/gridengine/60patches.txt

The courtesy binaries are available at:

   http://gridengine.sunsource.net/project/gridengine/download60.html

The list of fixed problems is available at

   http://gridengine.sunsource.net/project/gridengine/60patches.txt

The patch installation notes are available at

   http://gridengine.sunsource.net/project/gridengine/install60patch.txt

Please send support questions and feedback to the "users" mailing of the
Grid Engine open source project.

The corresponding source code tag in the CVS repository has the name

   V60u6_TAG

A snapshot of the sources is available at the Documents & files page

   http://gridengine.sunsource.net/servlets/ProjectDownloadList

as file

   sge-V60u6_TAG-src.tar.gz ( Aug 11 2005, 01:24:59 PM CEST ) Permalink Kommentare [0]