
Answer-first summary for fast verification
Answer: They can create a new task in the existing Job and then add it as a dependency of the original task.
## Explanation The correct answer is **B** because: 1. **Requirement Analysis**: The data engineer needs to run a new notebook **prior to** the original task. This means the new task must execute first, and then the original task should run. 2. **Task Dependencies in Databricks Jobs**: In Databricks, you can set up task dependencies where one task must complete before another can start. When you add a task as a dependency of another task, the dependent task will wait for the prerequisite task to complete. 3. **Option B Analysis**: - Create a new task in the existing Job (running the new notebook) - Add it as a dependency of the original task - This ensures the new task runs first, then the original task runs after it completes 4. **Why Other Options Are Incorrect**: - **Option A**: Cloning and updating the existing task would replace the original task, not add a new task before it. - **Option C**: Adding the original task as a dependency of the new task would make the original task run first, which is opposite of the requirement. - **Option D**: Creating a new job from scratch with concurrent tasks would run both tasks at the same time, not sequentially with the new task first. 5. **Best Practice**: This approach maintains the existing job structure while adding the necessary preprocessing step, which is efficient and maintains operational consistency.
Author: Keng Suppaseth
Ultimate access to all questions.
A data engineer has a single-task Job that runs each morning before they begin working. After identifying an upstream data issue, they need to set up another task to run a new notebook prior to the original task.
Which approach can the data engineer use to set up the new task?
A
They can clone the existing task in the existing Job and update it to run the new notebook.
B
They can create a new task in the existing Job and then add it as a dependency of the original task.
C
They can create a new task in the existing Job and then add the original task as a dependency of the new task.
D
They can create a new job from scratch and add both tasks to run concurrently.
No comments yet.