
Ultimate access to all questions.
You are tasked with designing an incremental data load strategy for a large e-commerce company that experiences daily fluctuations in sales data. The company wants to ensure that the data warehouse is updated with only the new transactions each day. Describe the steps you would take to implement this strategy using Azure Data Factory, including the use of watermarks and the integration of Azure SQL Database as the source system.
A
Use a full load approach and schedule the pipeline to run every day at midnight.
B
Implement a watermarking strategy by creating a pipeline that identifies the maximum transaction ID from the previous load and uses this as a filter for the next load.
C
Manually update the data warehouse each day with the new transactions.
D
Use a lookup activity to retrieve the latest transaction date and filter the source data based on this date.