
Ultimate access to all questions.
When using Auto Loader to ingest JSON files from a cloud location with the following configuration:
.schema(schema) \
.option("cloudFiles.format", "json") \
.option("cloudFiles.schemaEvolutionMode", "addNewColumns") \
.load(source)
.schema(schema) \
.option("cloudFiles.format", "json") \
.option("cloudFiles.schemaEvolutionMode", "addNewColumns") \
.load(source)
What happens if a file with an added column arrives at the source location?
A
The stream will fail and the new column is added to _rescued_data column.
B
The schema will evolve and the stream will continue to run.
C
The stream will fail and the schema will not be evolved.
D
The stream will continue and the new column will be ignored.
E
The schema will be evolved but the stream will fail.