
Ultimate access to all questions.
Consider a situation where you need to orchestrate a multi-task ML workflow using Databricks jobs. Describe how you would design these jobs to handle complex dependencies and ensure that each task is executed in the correct sequence, considering factors such as task priority and resource allocation.
A
Design each task as a separate job with no dependencies
B
Use a single Databricks job to execute all tasks sequentially
C
Define each task as a separate job with dependencies based on task priority
D
Use a combination of Databricks jobs and external scheduling tools to manage complex dependencies