Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
When a dataset defined with Delta Live Tables includes an expectations clause, such as CONSTRAINT valid_timestamp EXPECT (timestamp > ‘2020-01-01‘), and a batch of data containing violations of these constraints is processed, what happens?
When a dataset defined with Delta Live Tables includes an expectations clause, such as CONSTRAINT valid_timestamp EXPECT (timestamp > ‘2020-01-01‘), and a batch of data containing violations of these constraints is processed, what happens?
Real Exam
Explanation:
The correct answer is D. Delta Live Tables handles data that violates expectations by including it in the target dataset and logging the violation in the event log. This approach allows for the identification and handling of invalid records without stopping the processing job. Delta Live Tables supports various expectation types to manage bad data within pipelines effectively.