Lifecycles

There are several lifecycles in the server, and here we shall focus on datasets, jobs, and tasks.

Color Key

  • blue - standard flow
  • cyan - standard flow that can be overridden
  • green - debug flag override
  • red - manual intervention

Datasets

../../_images/lifecycle_dataset.png

Jobs

../../_images/lifecycle_job.png

Tasks

../../_images/lifecycle_task.png
  • idle: tasks in global queue
  • waiting: tasks in local queue
  • queued: tasks queued to a batch system
  • processing: tasks are running
  • suspended: if debug = True suspend instead of reset or fail
  • reset: shallow reset
    • by default goes back to waiting
    • if reset >= 3, back to idle
  • resume: hard reset