Databricks Certified Data Engineer - Professional

Databricks Certified Data Engineer - Professional

Get started today

Ultimate access to all questions.


A data engineer is configuring a pipeline with Optimized Writes and Auto Compaction using the following Spark configurations:

spark.conf.set("spark.databricks.delta.autoCompact.enabled", True)```

They aim to further enhance performance by enabling Z-order indexing with Auto Compaction for data skipping across all pipeline tables. Which solution correctly achieves this?





Comments

Loading comments...