Answer-first summary for fast verification
Answer: Schema location is used to store the schema inferred by AUTO LOADER for efficiency in subsequent runs.
The schema location in AUTO LOADER is crucial for storing the inferred schema, which allows AUTO LOADER to skip the schema inference process in subsequent runs, thereby improving efficiency. This is achieved by sampling the first 50 GB or 1000 files, whichever comes first, and storing the schema in a hidden directory `_schemas` at the specified location. This practice ensures a stable schema across stream restarts and avoids the cost of schema inference at every start. For more details on AUTO LOADER options, refer to the official documentation.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
No comments yet.
What is the purpose of the schema location in AUTO LOADER?
A
Schema location is used to store the schema inferred by AUTO LOADER for efficiency in subsequent runs.
B
Schema location is used to identify the schema of the target table only.
C
AUTO LOADER does not require a schema location due to its support for schema evolution.
D
Schema location is used to store a user-provided schema.
E
Schema location is used to identify the schema of both the target and source tables.