Explanation:
In Databricks Workflows, you can orchestrate multi-task jobs and control the execution order by setting dependencies. By adding both tasks to the same job and defining Task A as a dependency (depends_on) for Task B, the workflow will ensure Task B only starts if Task A finishes successfully.
Ultimate access to all questions.
A
Schedule Task B to start a fixed 30 minutes after Task A.
B
Add both tasks to a single Job and define Task A as a dependency for Task B.
C
Use a Python script to monitor Task A's status.
D
Run both tasks on the same cluster concurrently.
No comments yet.