Answer-first summary for fast verification
Answer: SCD Type 1 tables can be implemented in Delta Lake using the `MERGE INTO` statement to update existing records in place, which is efficient for certain use cases but does not track historical changes.
Option D is correct because it accurately describes the implementation of an SCD Type 1 table in Delta Lake using the `MERGE INTO` statement, which updates records in place. This approach is efficient for scenarios where tracking historical changes is not a requirement. However, it's important to note that SCD Type 1 does not track historical changes, which is a limitation for compliance and reporting purposes. The other options either misrepresent the capabilities of SCD Type 0 and Type 1 tables or incorrectly state that SCD Type 2 is the only option for tracking historical changes.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
No comments yet.
In a data engineering project, you are tasked with implementing Slowly Changing Dimension (SCD) tables in Delta Lake to handle both streaming and batch data workloads. The project requires tracking historical changes for compliance and reporting purposes, while also ensuring the solution is cost-effective and scalable. Considering these requirements, which of the following statements accurately describes the correct approach to implement an SCD Type 1 table in Delta Lake? Choose one option.
A
SCD Type 0 tables are sufficient for tracking historical changes as they automatically version all data changes without additional configuration.
B
SCD Type 1 tables update existing records in place to reflect changes, without tracking historical data, making them unsuitable for compliance and reporting needs.
C
SCD Type 2 tables, by creating a new record for each change and tracking valid-from and valid-to dates, are the only option for tracking historical changes in Delta Lake.
D
SCD Type 1 tables can be implemented in Delta Lake using the MERGE INTO statement to update existing records in place, which is efficient for certain use cases but does not track historical changes.