
Answer-first summary for fast verification
Answer: cloudFiles.schemaEvolutionMode = "addNewColumns"
Auto Loader supports automatic schema evolution with cloudFiles.schemaEvolutionMode = "addNewColumns".
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
You are ingesting JSON files with Auto Loader. A new field is added to the incoming data. You want the pipeline to automatically include the new field without failing. Which configuration should you use?
A
cloudFiles.schemaEvolutionMode = "addNewColumns"
B
mergeSchema = true
C
spark.sql.streaming.schemaInference = true
D
cloudFiles.allowSchemaDrift = true
No comments yet.