Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
Ultimate access to all questions.
Differentiate between all-purpose clusters and job clusters in Databricks.
A data engineering team has developed a Python notebook to load data from cloud storage. The job has been tested and is now ready to be scheduled for production.
Which type of cluster would be the most suitable for this scenario?
Explanation:
Jobs clusters are specifically designed for running automated, scheduled production jobs, making them the optimal choice for this scenario. They are cost-efficient and terminate after job completion, unlike all-purpose clusters which are meant for interactive development. Unity Catalog-enabled clusters and Serverless SQL warehouses do not fit the requirement for running a Python notebook in a production schedule.