Answer-first summary for fast verification
Answer: JSON data is a text-based format
JSON is a text-based format, which means that when data is ingested without schema hints or type inference, Auto Loader interprets all the data as text (string) by default. This is why all the columns in the target table are of the string type.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
No comments yet.
A data engineer has implemented a data pipeline to ingest data from a JSON source utilizing Auto Loader. However, the pipeline lacks type inference or schema hints. Upon inspection of the ingested data, the data engineer observed that all columns in the resulting target table are of the string data type, even though some fields actually contain only float or boolean values. What is the reason that Auto Loader has inferred all columns as string types?
A
Auto Loader cannot infer the schema of ingested data
B
JSON data is a text-based format
C
Auto Loader only works with string data
D
All of the fields had at least one null value