Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
In the context of implementing Slowly Changing Dimension (SCD) Type 2 tables in Delta Lake within a Microsoft Azure environment, consider the following scenario: A retail company wants to track historical changes in product prices over time to analyze pricing trends and make informed decisions. The solution must ensure data integrity, support high query performance for reporting purposes, and minimize storage costs. Which of the following best describes the correct approach to implement an SCD Type 2 table to meet these requirements? Choose one option.
A
SCD Type 2 tables can be implemented by simply adding a timestamp column to each record without the need for valid-from and valid-to dates, as Delta Lake automatically tracks changes.
B
To implement an SCD Type 2 table, you should only update the existing record with the new price and not insert a new record, to save storage space and improve performance.
C
For each price change, insert a new record with the valid-from date set to the current date and the valid-to date set to a future date or null, and update the valid-to date of the previous record to the current date.
D
SCD Type 2 tables are not suitable for tracking historical changes in product prices; instead, use a Type 1 SCD to overwrite the old price with the new one.