Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
When querying a large table partitioned by date in Spark, which method allows Spark to dynamically prune partitions to optimize the query execution plan?
A
Manually specifying the partition columns in the WHERE clause of the query.
B
Annotating the query with hints to explicitly specify which partitions to include.
C
Utilizing Spark‘s dynamic partition pruning feature by enabling it in Spark‘s configuration settings.
D
Leveraging broadcast variables to share partition metadata across nodes.