Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
A data engineering team has implemented a weekly batch job to process customer data deletion requests ("right to be forgotten") at 1am every Sunday, completing within one hour. All user data is stored in Delta Lake tables with default settings. A separate weekly VACUUM operation runs at 3am every Monday across all Delta Lake tables.
Given that Delta Lake's time travel capability could potentially allow access to deleted data, and assuming proper deletion logic implementation, which statement accurately resolves the compliance officer's concern?
A
Because the VACUUM command permanently deletes all files containing deleted records, deleted records may be accessible with time travel for around 24 hours.
B
Because the default data retention threshold is 24 hours, data files containing deleted records will be retained until the VACUUM job is run the following day.
C
Because Delta Lake time travel provides full access to the entire history of a table, deleted records can always be recreated by users with full admin privileges.
D
Because Delta Lake's delete statements have ACID guarantees, deleted records will be permanently purged from all storage systems as soon as a delete job completes.
E
Because the default data retention threshold is 7 days, data files containing deleted records will be retained until the VACUUM job is run 8 days later.