Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
When a dataset defined with Delta Live Tables includes an expectations clause like CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION DROP ROW, what happens to records violating this constraint during batch processing?
CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION DROP ROW
A
The violating records are added to the target dataset and marked as invalid in the event log.
B
The violating records are dropped from the target dataset and noted as invalid in the event log.
C
The job fails upon encountering records that violate the expectation.
D
Violating records are included in the target dataset with an additional field flagging them as invalid.
E
Records that violate the expectation are excluded from the target dataset and placed into a quarantine table.