Answer-first summary for fast verification
Answer: Utilize the Databricks cluster pools feature to reserve VMs in advance.
Cluster pools allow for the reservation of VMs ahead of time, enabling new job clusters to quickly grab VMs from the pool. This significantly reduces startup time. It's important to note that while VMs are waiting in the pool, only the Azure cost is incurred; Databricks runtime costs are billed only once a VM is allocated to a cluster. For a demonstration on setting up a pool and best practices, refer to the provided resources.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
To ensure your Databricks job runs immediately without waiting for cluster startup, which feature should you utilize to reduce the cluster's startup time?
A
Schedule an additional job to run before the main job to keep the cluster running.
B
Utilize the Databricks cluster pools feature to reserve VMs in advance.
C
Upgrade to Databricks Premium edition from the Standard edition.
D
Pin the cluster in the cluster UI to ensure it's always available for jobs.
E
Disable auto-termination to keep the cluster running continuously.
No comments yet.