
Ultimate access to all questions.
You are a Data Engineer working on a project that requires the deployment of batch jobs in a production environment on Microsoft Azure. The project has strict requirements for cost efficiency, compliance with data governance policies, and the ability to scale based on workload demands. Additionally, the team needs to ensure high availability and early detection of any issues to minimize downtime. Considering these constraints, which of the following strategies would you implement to deploy and monitor the batch jobs effectively? (Choose one option)
A
Deploy the batch jobs using Azure Virtual Machines without any monitoring tools, relying solely on manual checks for issue detection, to minimize costs.
B
Deploy the batch jobs with Azure Batch service, enabling basic logging for error tracking but skipping advanced monitoring and alerting to reduce complexity.
C
Deploy the batch jobs using Azure Databricks, implementing comprehensive monitoring with Azure Monitor to track performance metrics, system health, and error logs, and setting up alert rules for proactive issue detection.
D
Deploy the batch jobs with Azure Functions, monitoring only the execution time of each job to keep the monitoring overhead low.