Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
In the context of a DLT pipeline handling streaming data, what approach ensures the pipeline can automatically adapt to upstream schema changes without compromising data integrity?
A
Utilize a preliminary schema detection notebook that executes before the pipeline to pinpoint and implement required modifications.
B
Incorporate schema evolution controls within the pipeline's configuration to enable automatic adaptation to schema changes.
C
Depend on Delta Lake's mergeSchema feature within the pipeline to manage schema alterations.
D
Manually halt the pipeline, adapt to schema changes, and then resume processing.