Explanation:
Auto Loader offers two modes for ingesting new files from cloud object storage:
The file notification mode is more efficient, enabling real-time data processing as it arrives in cloud object storage.
For more details, refer to: Choosing between file notification and directory listing modes | Databricks on AWS
When setting up an AUTO LOADER to process incoming JSON data that arrives in cloud object storage, which statement accurately describes its capabilities?
A
AUTO LOADER is exclusive to DELTA lake and does not support external cloud object storage.
B
AUTO LOADER requires manual triggering from an external process upon file arrival in cloud storage.
C
AUTO LOADER must be converted into a Structured stream process to function.
D
AUTO LOADER is limited to processing continuous data only within DELTA lake.
E
AUTO LOADER can utilize a file notification method to process data in real-time as it arrives.
No comments yet.