Answer-first summary for fast verification
Answer: spark.conf.set("spark.databricks.delta.liquid.eagerClustering.streaming.enabled", "true")
Structured Streaming workloads support clustering on write when you set spark.databricks.delta.liquid.eagerClustering.streaming.enabled to true. Reference:https://docs.databricks.com/aws/en/delta/clustering#write-data-to-a-clustered-table
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
You want to enable clustering on write for a Structured Streaming job. Which Spark config must be set?
A
spark.conf.set("spark.databricks.delta.liquid.streaming.enabled", "true")
B
spark.conf.set("spark.databricks.delta.liquid.eagerClustering.streaming.enabled", "true")
C
spark.conf.set("spark.databricks.delta.streaming.liquid.enabled", "true")
D
spark.conf.set("spark.databricks.delta.liquid.streaming.auto", "true")
No comments yet.