Answer-first summary for fast verification
Answer: Violating records are included in the target dataset and their invalidity is recorded in the event log.
The correct answer is D. Delta Live Tables handles data that violates expectations by including it in the target dataset and logging the violation in the event log. This approach allows for the identification and handling of invalid records without stopping the processing job. Delta Live Tables supports various expectation types to manage bad data within pipelines effectively.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
When a dataset defined with Delta Live Tables includes an expectations clause, such as CONSTRAINT valid_timestamp EXPECT (timestamp > ‘2020-01-01‘), and a batch of data containing violations of these constraints is processed, what happens?
A
The job fails immediately upon encountering any records that violate the expectation.
B
Violating records are excluded from the target dataset but noted as invalid in the event log.
C
Violating records are included in the target dataset and marked as invalid within an additional field.
D
Violating records are included in the target dataset and their invalidity is recorded in the event log.
E
Violating records are excluded from the target dataset and placed into a quarantine table.
