Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
A data engineer has set up a notebook to automatically process using a Job. The data engineer's manager wants to version control the schedule due to its complexity. Which of the following approaches can the data engineer use to obtain a version-controllable configuration of the Job's schedule?
Exam-Like
Community
KKeng
A
They can link the Job to notebooks that are a part of a Databricks Repo.
B
They can submit the Job once on a Job cluster.
C
They can download the JSON description of the Job from the Job's page.
D
They can submit the Job once on an all-purpose cluster.
E
They can download the XML description of the Job from the Job's page.
Explanation:
Explanation
The correct answer is C because:
-
JSON Job Configuration: In Databricks, you can export the complete Job configuration (including schedule settings) as a JSON file from the Job's page. This JSON file contains all the Job settings, including the schedule configuration, notebook references, cluster settings, and other parameters.
-
Version Control Compatibility: The JSON format is ideal for version control systems like Git because it's a plain text format that can be easily tracked, compared, and managed. This allows teams to maintain different versions of the Job schedule configuration and track changes over time.
-
Why other options are incorrect:
- A: Linking notebooks to a Databricks Repo helps with notebook version control, but doesn't capture the Job's schedule configuration.
- B & D: Submitting the Job on any type of cluster doesn't create a version-controllable configuration file.
- E: Databricks doesn't provide XML descriptions of Jobs; it uses JSON format for Job configurations.
-
Practical Application: Once the JSON is downloaded, it can be stored in a Git repository, allowing for:
- Version history tracking
- Change reviews through pull requests
- Rollback to previous configurations if needed
- Team collaboration on schedule changes
This approach aligns with Databricks best practices for managing complex Job schedules in production environments.
Comments
Loading comments...