Ultimate access to all questions.
A data engineer is configuring a pipeline with Optimized Writes and Auto Compaction using the following Spark configurations:
spark.conf.set("spark.databricks.delta.autoCompact.enabled", True)```
They aim to further enhance performance by enabling Z-order indexing with Auto Compaction for data skipping across all pipeline tables. Which solution correctly achieves this?