Databricks Certified Data Engineer - Professional
Comments
Loading comments...
Ultimate access to all questions.
A data architect is considering using Delta Lake’s time travel feature for long-term auditing of valid street addresses in a customers table. They plan to implement a Type 1 table architecture (where records are overwritten) and rely on time travel to retrieve historical states. A data engineer suggests that a Slowly Changing Dimension (SCD) Type 2 table would be a more performant and scalable solution. Which of the following statements provides the critical justification for the data engineer's suggestion?
A
Shallow clones can be utilized in conjunction with Type 1 tables to significantly accelerate historical queries for long-term versioning.
B
Delta Lake time travel is not efficient in terms of cost or latency when used for long-term auditing and data retention.
C
Time travel cannot access previous versions of Type 1 tables because Delta Lake updates modify the underlying data files in place.
D
SCD Type 2 tables require updating multiple fields in a single operation, which increases the risk of data corruption if a query fails during a partial update.