In a scenario where you are tasked with optimizing a Delta Lake table for ad-hoc querying in a cost-sensitive environment, which of the following actions would you take to significantly improve query performance while ensuring data integrity and compliance with data governance policies? Consider the need for scalability and the potential impact on operational costs. Choose the best option.

Simulated

Increase the file size to 1GB to reduce the number of files, thereby improving query performance but potentially increasing the time for data recovery in case of failures.

15.9%

Add all possible columns to the table to maximize storage utilization, ignoring the impact on query performance and storage costs.

1.5%

Implement columnar storage and predicate pushdown to enhance query performance by reducing the amount of data scanned and leveraging the query engine's ability to push down predicates, without compromising data integrity.

78.6%

Disable all transaction logs to expedite data ingestion and updates, sacrificing the ACID properties that ensure data integrity.

4.0%

Databricks Certified Data Engineer - Professional

Get started today

Comments