Explanation:
The correct answer is DELTA LIVE TABLES. Delta Live Tables expectations can be used to identify and quarantine bad data, with all data quality metrics stored in the event logs for later analysis and monitoring. There are three types of expectations: Retain invalid records, Drop invalid records, and Fail on invalid records, each serving different purposes in handling data quality issues.
Ultimate access to all questions.
No comments yet.
You are tasked with building a data pipeline and have identified a data source with significant quality issues. To monitor and enforce data quality during the ingestion process, which tool would you choose?
A
UNITY Catalog and Data Governance
B
DELTA LIVE TABLES
C
STRUCTURED STREAMING with MULTI HOP
D
JOBS and TASKS
E
AUTO LOADER