In a scenario where you have a dataset of medical records, which includes columns like patient_id, doctor_id, diagnosis, and timestamp. Explain how you would decide on the appropriate partitioning strategy for this dataset to optimize query performance. Consider the frequency of queries and the nature of the data.

Simulated

Partition by patient_id, as it is likely that queries will often filter by individual patients._

48.4%

Partition by doctor_id, as it is likely that queries will often filter by individual doctors._

15.4%

Partition by diagnosis, as it is likely that queries will often filter by specific diagnoses.

15.4%

Partition by timestamp, as it is likely that queries will often filter by time ranges.

20.7%

Databricks Certified Data Engineer - Professional