Queueing Module

The queue module is responsible for interacting with the local batch or queueing system, putting tasks on the queue and removing them as necessary.

exception iceprod.server.modules.queue.StopException

class iceprod.server.modules.queue.queue(*args, **kwargs)

Run the queue module, which queues jobs onto the local grid system(s).

start()

Start the queue

queue_loop(*args, **kwargs)

Run the queueing loop

check_proxy(*args, **kwargs)

Check the x509 proxy

global_queueing(*args, **kwargs)

Do global queueing.

Fetch tasks from the global server that match the local resources and add them to the local DB. This is non-blocking, but only one at a time can run.

Parameters:

• queueing_factor_priority – queueing factor for priority
• queueing_factor_dataset – queueing factor for dataset id
• queueing_factor_tasks – queueing factor for number of tasks
• num – number of tasks to queue

buffer_jobs_tasks(*args, **kwargs)

Make sure active datasets have jobs and tasks defined