Explanation:
Auto Loader adds a _rescued_data column automatically when it infers the schema. This column captures any data that doesn't match the schema due to missing columns, type mismatches, or case mismatches, ensuring no data is lost. The data is stored in JSON format within this column, including the source file path of the record. You can rename this column or include it explicitly by setting the rescuedDataColumn option.
Which column does Auto Loader automatically add to capture malformed data during incremental data ingestion, ensuring no data is dropped due to schema mismatches?
A
rescued_data_
B
_rescued_data
C
rescuedData
D
rescued_data
E
rescued_data
No comments yet.