
Ultimate access to all questions.
In the context of managing a Delta Lake environment within Azure Databricks, you are responsible for ensuring comprehensive visibility into system usage and performance for auditing and monitoring purposes. The solution must adhere to organizational policies emphasizing cost-efficiency, scalability, and compliance with data governance standards. Considering these requirements, which of the following strategies would BEST meet these objectives? Choose one option.
A
Relying exclusively on the basic logging capabilities of the underlying Azure Blob Storage, without any additional monitoring tools or Delta Lake features, to minimize costs.
B
Developing and deploying a custom monitoring solution that bypasses Delta Lake's native auditing and monitoring features, aiming for a tailored approach despite potential scalability challenges.
C
Integrating Delta Lake's built-in auditing and monitoring features with Azure Monitor and Log Analytics to achieve a scalable, cost-efficient, and comprehensive monitoring solution that complies with data governance standards.
D
Eliminating all forms of logging and monitoring to prioritize system performance, under the assumption that this will also reduce costs and simplify compliance.