
Explanation:
When using the Databricks Jobs REST API v2.1, complex job dependencies can be defined using the depends_on field inside the task definitions. This field allows for specifying conditional execution based on the outcome of preceding tasks, with options like SUCCESS, FAILED, or SKIPPED to control the flow. This method enables conditional branching, failure handling, and skipped task behavior directly in the job JSON.
depends_on field.depends_on.Ultimate access to all questions.
No comments yet.
How can you specify complex job dependencies, such as conditional execution based on the outcome of preceding tasks, using the Databricks REST API?
A
Embedding custom Scala or Python code in the API payload to evaluate conditions
B
By defining a JSON configuration in the dependencies field for each task
C
Databricks REST API does not support conditional task dependencies; use Databricks Workflows instead.
D
Utilizing the chain operation to link tasks sequentially with conditional checks