Explanation:
Job Clusters are ephemeral clusters that are created when a job starts and terminated when the job completes. This fits the requirements of scheduled execution, no need for always-on compute, and automatic shutdown to control costs. All-Purpose and Interactive Clusters are meant for interactive use and remain running, while SQL Endpoints are for SQL workloads.
You are running a Lakeflow Job for a production workflow that: Executes on a schedule. Does not require an always-on cluster. Should automatically shut down compute after the job completes to control costs. Which compute option best fits this use case?
A
SQL Endpoint
B
Job Clusters
C
All-Purpose Cluster
D
Interactive Clusters
No comments yet.