
Answer-first summary for fast verification
Answer: AUTO LOADER can utilize a file notification method to process data in real-time as it arrives.
Auto Loader offers two modes for ingesting new files from cloud object storage: 1. **Directory listing**: Auto Loader detects new files by listing the input directory, employing a directory polling approach. 2. **File notification**: Auto Loader can automatically configure a notification and queue service that subscribes to file events from the input directory. The file notification mode is more efficient, enabling real-time data processing as it arrives in cloud object storage. For more details, refer to: [Choosing between file notification and directory listing modes | Databricks on AWS](https://docs.databricks.com)
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
When setting up an AUTO LOADER to process incoming JSON data that arrives in cloud object storage, which statement accurately describes its capabilities?
A
AUTO LOADER is exclusive to DELTA lake and does not support external cloud object storage.
B
AUTO LOADER requires manual triggering from an external process upon file arrival in cloud storage.
C
AUTO LOADER must be converted into a Structured stream process to function.
D
AUTO LOADER is limited to processing continuous data only within DELTA lake.
E
AUTO LOADER can utilize a file notification method to process data in real-time as it arrives.
No comments yet.