Answer-first summary for fast verification
Answer: The table was cleaned using the VACUUM command
The VACUUM command in Delta Lake removes old data files that are no longer accessible by any version of the dataset, due to retention policies. This helps in managing storage costs and keeping the data lake clean by deleting obsolete files beyond the retention period. The default retention period is 7 days, but it can be configured to be shorter. If a data engineer tries to time travel to a version of the table that is older than the retention threshold and those files have been vacuumed, the data for that version will no longer be available, leading to the missing files issue.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
A data engineer found an error in a daily table update and attempted to use Delta Lake's time travel feature to revert the table to its state from three days ago. However, the attempt failed because the necessary data files were missing. What could be the reason for the absence of these data files?
A
The HISTORY command was run on the table
B
The OPTIMIZE command was applied to the table
C
The table was cleaned using the VACUUM command
D
The TIME TRAVEL feature was utilized on the table
E
The DELETE HISTORY command was executed on the table
No comments yet.