Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
A data engineer has been using a Databricks SQL dashboard to monitor the cleanliness of the input data to an ELT job. The ELT job has its Databricks SQL query that returns the number of input records containing unexpected NULL values. The data engineer wants their entire team to be notified via a messaging webhook whenever this value reaches 100. Which of the following approaches can the data engineer use to notify their entire team via a messaging webhook whenever the number of NULL values reaches 100?
Real Exam
Community
KKeng
A
They can set up an Alert with a custom template.
B
They can set up an Alert with a new email alert destination.
C
They can set up an Alert with a new webhook alert destination.
D
They can set up an Alert with one-time notifications.
E
They can set up an Alert without notifications.
Explanation:
Explanation
Option C is correct because:
-
Webhook Alert Destination: Setting up an alert with a new webhook alert destination allows the data engineer to configure the alert to send notifications via a webhook when the threshold (100 NULL values) is reached.
-
Messaging Integration: Webhooks are specifically designed to integrate with messaging systems like Slack, Microsoft Teams, Discord, or other collaboration tools that support webhook notifications.
-
Team Notification: This approach enables the entire team to receive notifications through their preferred messaging platform when the alert condition is met.
Why other options are incorrect:
- Option A: Custom templates allow message customization but don't specify the delivery mechanism. A custom template alone doesn't ensure webhook delivery.
- Option B: Email alert destinations send notifications via email, not via messaging webhooks as requested.
- Option D: One-time notifications might only send alerts once, but the requirement is for notifications whenever the threshold is reached (potentially multiple times).
- Option E: Without notifications, no alert would be sent to the team, defeating the purpose of monitoring.
Key Databricks Concepts:
- Databricks SQL Alerts can be configured with different notification destinations
- Webhook destinations allow integration with external systems
- Alert conditions can be based on query results (like NULL count reaching 100)
- This is part of production monitoring and alerting in data pipelines
Comments
Loading comments...