Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
Deep dive into the quiz with AI chat providers.
We prepare a focused prompt with your quiz and certificate details so each AI can offer a more tailored, in-depth explanation.
Question 42
A data engineering team has been using a Databricks SQL query to monitor the performance of an ELT job. The ELT job is triggered by a specific number of input records being ready to process. The Databricks SQL query returns the number of minutes since the job's most recent runtime.
Which of the following approaches can enable the data engineering team to be notified if the ELT job has not been run in an hour?
Real Exam
Community
LLeetQuiz
A
They can set up an Alert for the accompanying dashboard to notify them if the returned value is greater than 60.
B
They can set up an Alert for the query to notify when the ELT job fails.
C
They can set up an Alert for the accompanying dashboard to notify when it has not refreshed in 60 minutes.
D
They can set up an Alert for the query to notify them if the returned value is greater than 60.
E
This type of alerting is not possible in Databricks.
Explanation:
Explanation
Option D is the correct answer because:
- The Databricks SQL query returns the number of minutes since the job's most recent runtime
- Setting up an alert on the query itself allows monitoring the query results directly
- When the returned value (minutes since last run) is greater than 60, it means the job hasn't run in over an hour
- Query alerts in Databricks can be configured to trigger when query results meet specific conditions
Why other options are incorrect:
- Option A: Dashboard alerts monitor dashboard refresh status, not the actual query results
- Option B: This would only notify on job failures, not on the job not running at all
- Option C: Dashboard refresh alerts don't monitor the actual job runtime data
- Option E: This type of alerting is absolutely possible in Databricks through query alerts
This approach provides proactive monitoring to ensure the ELT job is running as expected based on the input record trigger condition.
Comments
Loading comments...