Answer-first summary for fast verification
Answer: Use clusters that are from a cluster pool
Using clusters from a cluster pool can significantly reduce the start-up time for clusters used in the Job. Cluster pools contain pre-configured and pre-started clusters that are ready for use, eliminating the need to start new clusters from scratch each time a Job runs.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
As a data engineer, you have a Job scheduled to run nightly, comprising multiple tasks. However, each task experiences slow execution times due to the lengthy start-up duration of the clusters. Which of the following actions can you take to expedite the start-up times for the clusters used in the Job?
A
Use endpoints available in Databricks SQL
B
Use jobs clusters instead of all-purpose clusters
C
Configure the clusters to be single-node
D
Use clusters that are from a cluster pool
No comments yet.