Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
You are tasked with setting up a scheduled job that populates a reporting table every hour for downstream processes. Which type of cluster should you use for this job?
You are tasked with setting up a scheduled job that populates a reporting table every hour for downstream processes. Which type of cluster should you use for this job?
Real Exam
Explanation:
The correct answer is to use a job cluster for this purpose. Job clusters are optimized for scheduled tasks where interaction with the notebook during execution is not required, making them more cost-effective than all-purpose clusters. Additionally, job clusters are terminated upon job completion, which is a standard practice for scheduled jobs to optimize resource usage.