Explanation:
Auto Loader incrementally discovers files in cloud storage and tracks which files have already been processed. It does not require the pipeline to delete or move source files and is designed for continuously accumulating directories.
A shared directory accumulates source files that must remain untouched. The pipeline must identify and ingest only files that are new since the previous run. Which tool should be used?
A
Unity Catalog
B
Delta Lake
C
Databricks SQL
D
Auto Loader
No comments yet.