You are optimizing a lakehouse for complex time-based queries against a decade of historical data, with a focus on ensuring optimal performance for queries on recent data (up to one month old). How should you structure your partitions?

Real Exam

Use a flat partitioning scheme based on ingestion time, relying on the lakehouse's automatic optimization features to handle query performance.

5.2%

Create separate tables for historical and recent data, with recent data partitioned by day and historical data by year, and use a view to unify them for querying.

11.3%

Partition data by year, then by month, applying Z-ordering on the most queried columns within the recent data partition.

37.1%

Implement a hybrid partitioning scheme that partitions recent data daily and historical data monthly to optimize for query access patterns.

46.4%

Databricks Certified Data Engineer - Professional

Get started today

Comments

You are optimizing a lakehouse for complex time-based queries against a decade of historical data, with a focus on ensuring optimal performance for queries on recent data (up to one month old). How should you structure your partitions?