
Ultimate access to all questions.
In a Databricks environment, you are tasked with orchestrating the execution of multiple notebooks that must run in a specific sequence due to data dependencies. The solution must be scalable, minimize manual intervention, and ensure reliability in a production setting. Considering these requirements, which of the following approaches is the BEST to establish a dependency chain between these notebooks? (Choose one option)
A
Manually execute each notebook in the required order, documenting the sequence for future reference.
B
Utilize the Databricks Jobs feature to define a job for each notebook and configure dependencies between these jobs to automate the execution sequence.
C
Embed a custom script within each notebook that verifies the completion of the preceding notebook before initiating its own execution.
D
Apply the %run magic command in each notebook to call the preceding notebook, creating an implicit execution order.