Databricks Certified Data Engineer - Associate
Comments
Loading comments...
Ultimate access to all questions.
In a scenario where you are managing a Delta Lake table that has accumulated a large number of small files due to frequent updates and deletes, you need to optimize both storage efficiency and query performance. Considering the constraints of minimizing operational overhead and ensuring compliance with data retention policies, which of the following actions should you take? Additionally, what is the primary benefit of using the OPTIMIZE command in this context? Choose the best option that describes the role of the OPTIMIZE command and the type of files it affects. (Choose one correct answer)
A
The OPTIMIZE command is used to deduplicate the data in the table, removing duplicate rows and improving query performance by reducing the volume of data scanned.
B
The OPTIMIZE command is used to update the metadata of the table, ensuring that the table schema is up-to-date and consistent, which indirectly improves query performance by facilitating better query planning.
C
The OPTIMIZE command is used to compact small files in the table, merging them into larger files and reducing the overall number of files, which improves query performance by decreasing the number of files that need to be scanned.
D
The OPTIMIZE command is used to repartition the data in the table, redistributing the data across partitions to improve query performance by ensuring data is evenly distributed and reducing skew.