Explanation:
Delta Lake maintains an ACID-compliant transaction log that keeps a single source of truth of the files in the directory. By converting from plain Parquet to Delta Lake, Databricks will automatically consult the transaction log for the latest snapshot, completely eliminating the need to manually execute REFRESH TABLE or clear Spark's directory listings cache.
Ultimate access to all questions.
A
Restart the Databricks cluster hourly.
B
Convert the table format to Delta Lake.
C
Run REFRESH TABLE before every read operation.
D
Move the files to a different cloud region.
No comments yet.