Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
What is the most efficient practice for implementing an incremental load strategy into Delta Lake using the COPY INTO command to ensure only new or updated files are processed?
A
Using a cloud storage event-driven function to move processed files to a different directory, keeping the source directory clean.
B
Configuring COPY INTO to automatically identify and skip files based on a timestamp or version column in the data.
C
Manually tracking processed files in a separate Delta table and filtering them out in the COPY INTO command.
D
Relying on the inherent capabilities of COPY INTO to detect and ignore previously processed files without additional logic.
