Explanation:
The Silver layer represents a validated, cleansed, and enriched version of the data. While the Bronze layer preserves the raw state of the data, the transition to Silver involves critical data engineering tasks such as schema enforcement, deduplication, and data normalization. This ensures that downstream consumers (including the Gold layer or ad-hoc analytical queries) have access to high-quality, reliable datasets.
Ultimate access to all questions.
In the context of the Medallion Architecture within a Databricks Lakehouse, what is the primary objective of transforming data from the Bronze layer to the Silver layer?
A
To store raw, unprocessed data in its original source format for long-term archival and compliance.
B
To focus exclusively on physical storage optimizations, such as Z-ordering and partition pruning, without changing data content.
C
To refine the data through cleaning, deduplication, and enrichment, ensuring it is prepared for downstream analytics and processing.
D
To aggregate data into high-level business metrics and KPIs for final executive reporting.
No comments yet.