Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
A data engineer has been using a Databricks SQL dashboard to monitor the cleanliness of the input data to an ELT job. The ELT job has its Databricks SQL query that returns the number of input records containing unexpected NULL values. The data engineer wants their entire team to be notified via a messaging webhook whenever this value reaches 100. Which of the following approaches can the data engineer use to notify their entire team via a messaging webhook whenever the number of NULL values reaches 100?
Real Exam
Community
KKeng
A
They can set up an Alert with a custom template.
B
They can set up an Alert with a new email alert destination.
C
They can set up an Alert with a new webhook alert destination.
D
They can set up an Alert with one-time notifications.
E
They can set up an Alert without notifications.
Explanation:
Explanation
The correct answer is C because:
-
Webhook Alert Destination: Databricks SQL Alerts support webhook destinations that can send notifications to messaging platforms like Slack, Microsoft Teams, or other custom webhook endpoints.
-
Alert Configuration: The data engineer can:
- Create an Alert on the Databricks SQL query that monitors NULL values
- Set the alert condition to trigger when the query result reaches 100
- Configure a webhook alert destination pointing to their team's messaging platform
-
Why other options are incorrect:
- A (custom template): Custom templates only change the format of notifications but don't determine the delivery method
- B (email alert destination): This would send email notifications, not webhook notifications
- D (one-time notifications): This refers to notification frequency, not the delivery method
- E (without notifications): This would not send any notifications at all
-
Implementation Steps:
-- Query example that returns count of NULL values SELECT COUNT(*) as null_count FROM input_data WHERE column_name IS NULL;-- Query example that returns count of NULL values SELECT COUNT(*) as null_count FROM input_data WHERE column_name IS NULL;- Create Alert on this query
- Set condition:
null_count >= 100 - Add webhook destination with team's messaging webhook URL
- Configure alert to run on a schedule (e.g., every 5 minutes)
This approach ensures the team receives real-time notifications in their messaging platform when data quality issues reach the threshold.
Comments
Loading comments...