
Ultimate access to all questions.
You are responsible for monitoring the health and performance of data pipelines across BigQuery, Dataflow, and Dataproc, with a focus on detecting failures and ensuring timely notifications. Your solution must span multiple projects and prioritize the use of managed services or platform features. Which approach best meets these requirements?
A
Develop a custom App Engine application to fetch logs via GCP API calls and dispatch email alerts upon detecting failures.
B
Transfer logs to BigQuery, configure App Engine to analyze this data, and trigger email alerts for any identified failures.
C
Deploy a Virtual Machine in Compute Engine equipped with Airflow, then funnel the monitoring data into Cloud Monitoring.
D
Integrate the monitoring data into Cloud Monitoring and establish an Alerting policy for immediate failure notifications.