When setting up automated monitoring for a data pipeline in Azure Databricks, which method ensures the data engineering team receives immediate notifications of pipeline failures?

Real Exam

Use Databricks job logs with a custom Azure Function to parse logs and send alerts via Microsoft Teams.

8.7%

Implement Azure Monitor with Application Insights to track pipeline executions and configure email alerts for failures.

32.0%

Configure Databricks to output logs to Azure Log Analytics and set up alert rules for pipeline failure events.

56.3%

Rely on manual monitoring of Databricks workspace for job failures and report issues via email.

2.9%

Databricks Certified Data Engineer - Professional