Answer-first summary for fast verification
Answer: New files are identified by listing the input directory; new files are incrementally and idempotently loaded into the target Delta Lake table.
The default execution mode for Databricks Auto Loader is **Directory Listing**. In this mode, Auto Loader identifies new files by periodically listing the input directory. It then incrementally and idempotently loads these new files into the target Delta Lake table. This approach is efficient as it avoids reprocessing existing files and does not rely on cloud-specific notification services. Options A and E describe the File Notification mode, which is not the default and requires additional cloud services setup. Option B is incorrect because it suggests querying all files in the source directory, which contradicts the incremental loading feature of Auto Loader. Option C mentions webhooks, which are not a feature of Auto Loader. Therefore, the correct answer is D, as it accurately describes the default Directory Listing mode of Auto Loader.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
No comments yet.
What is the default execution mode for Databricks Auto Loader?
A
Cloud vendor-specific queue storage and notification services are configured to track newly arriving files; the target table is materialized by directly querying all valid files in the source directory.
B
New files are identified by listing the input directory; the target table is materialized by directly querying all valid files in the source directory.
C
Webhooks trigger a Databricks job to run anytime new data arrives in a source directory; new data are automatically merged into target tables using rules inferred from the data.
D
New files are identified by listing the input directory; new files are incrementally and idempotently loaded into the target Delta Lake table.
E
Cloud vendor-specific queue storage and notification services are configured to track newly arriving files; new files are incrementally and idempotently loaded into the target Delta Lake table.