Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
In a data engineering project, you are tasked with implementing Slowly Changing Dimension (SCD) tables in Delta Lake to handle both streaming and batch data workloads. The project requires tracking historical changes for compliance and reporting purposes, while also ensuring the solution is cost-effective and scalable. Considering these requirements, which of the following statements accurately describes the correct approach to implement an SCD Type 1 table in Delta Lake? Choose one option.
A
SCD Type 0 tables are sufficient for tracking historical changes as they automatically version all data changes without additional configuration.
B
SCD Type 1 tables update existing records in place to reflect changes, without tracking historical data, making them unsuitable for compliance and reporting needs.
C
SCD Type 2 tables, by creating a new record for each change and tracking valid-from and valid-to dates, are the only option for tracking historical changes in Delta Lake.
D
SCD Type 1 tables can be implemented in Delta Lake using the MERGE INTO statement to update existing records in place, which is efficient for certain use cases but does not track historical changes.