Execution

Execution

Learn about the different options for managing execution for Dagster Deployments.

Dagster daemon

The Dagster daemon process orchestrates the schedule, sensor, run queue, and run monitoring daemons.

Run launchers (Dagster OSS)

Run launchers in Dagster allocate computational resources to execute runs.

Run coordinators

The Dagster run coordinator lets you control the policy that Dagster uses to manage the set of runs in your deployment.

Customizing run queue priority

Customize Dagster run queue priority with concurrency settings, using dagster/priority tags to define and manage execution order and concurrency limits.

Detect and restart crashed workers with run monitoring

Dagster run monitoring detects and restarts crashed run workers.

Configuring run retries

Configure run retries in Dagster to manage whole-run failures, set maximum retry limits, and customize retry strategies via YAML or UI.

Executing Dagster on Celery

Execute Dagster jobs on Celery for scalable, parallel task management.

Executing Dagster on Dask

Use the dagster-dask module to execute Dagster jobs on Dask clusters.