
Ultimate access to all questions.
A data engineer needs to configure a Databricks notebook as a job to process data for five departments in an organization. The notebook requires an input parameter named department_name. Since there's no dependency between the departments, their tasks can run simultaneously. What approach should the data engineer take?_
A
Since a task in the job cannot accept an input parameter, create five separate notebooks with department_name hardcoded and set up five tasks with linear dependency in the job._
B
Use a single notebook as a task in the job and utilize dbutils.notebook.run() to execute each notebook with the department_name input parameter in different cells._
C
Parameters can only be passed at the job level. Therefore, create five jobs, pass the department_name parameter to each, with no dependencies between them._
D
A task can accept key-value pair parameters. Create five tasks within a single job, pass department_name as a parameter for each task, and set them to run in parallel without dependencies._
E
Parameters are only passable at the job level. Create five jobs, pass department_name to each, and establish a linear dependency between the jobs._