As a Databricks Certified Data Engineer - Associate, you are tasked with setting up a UC-enabled all-purpose cluster in Azure Databricks for a project that requires strict data governance and compliance with GDPR. The project involves processing large datasets with varying workloads, and the solution must be cost-effective while ensuring high performance. Which of the following steps is the BEST approach to create such a cluster, considering the need for data governance, scalability, and cost efficiency? (Choose one option)

Simulated

Create a new cluster, select the Data Engineering runtime, enable Unity Catalog, and configure auto-scaling to optimize costs.

81.1%

Create a new cluster, select the Machine Learning runtime, enable Unity Catalog, and manually set the number of workers to control costs.

4.1%

Create a new cluster, select the Data Science runtime, enable Unity Catalog, and use spot instances to reduce expenses.

3.5%

Create a new cluster, select the Analytics runtime, enable Unity Catalog, and disable auto-scaling to maintain consistent performance.

11.4%

Databricks Certified Data Engineer - Associate