Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
You are tasked with designing a data pipeline that needs to handle incremental data loads from a source system. Which of the following strategies would you use to implement this requirement in Azure Data Factory?
A
Use the 'High Water Mark' method by setting a variable to track the last processed record and filter the source data accordingly.
B
Load all data from the source system into a staging area and then use a 'Filter' activity to select only the new records.
C
Manually update a 'LastProcessedDate' column in a control table to track the last processed records and filter the source data based on this column.
D
Disable the incremental load feature and process all data from the source system in each pipeline run.
