
Ultimate access to all questions.
In a multi-task ML workflow scenario, you need to orchestrate a series of tasks using Databricks jobs. Describe how you would set up these jobs to ensure that they are executed in the correct order and that dependencies between tasks are properly managed, considering factors such as task priority and resource allocation.
A
Manually trigger each task in the correct order
B
Use a single Databricks job to sequentially execute all tasks
C
Define each task as a separate job and use dependencies to manage the execution order
D
Use a combination of Databricks jobs and external scheduling tools to manage task dependencies