
Ultimate access to all questions.
Which of the following describes a scenario in which a data engineer will want to use a Job cluster instead of an all-purpose cluster?
Explanation:
Job clusters are ephemeral clusters that are created and terminated for individual jobs or scheduled workflows. They are ideal for automated, recurring, production tasks because they provide isolation, reproducibility, and cost control (clusters run only for the duration of the job). An automated workflow that runs every 30 minutes is a classic use case for job clusters. In contrast, all-purpose clusters are intended for interactive, collaborative development and ad-hoc investigation (options A, B, and E). Databricks SQL scheduled queries typically use SQL warehouses/SQL endpoints rather than job clusters (option D). Therefore option C is the correct choice.