Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
What is the best approach to enforce schema consistency in a streaming application that writes to Delta Lake, ensuring schema evolution does not disrupt the stream?
A
Stream data to a raw Delta table and use batch jobs for schema validation and data movement to a production table.
B
Implement a schema registry that dynamically updates the Delta table schema before data ingestion.
C
Utilize mergeSchema option on each write operation, allowing automatic schema updates.
D
Disable schema enforcement, relying on manual schema updates during maintenance windows.
