Answer-first summary for fast verification
Answer: Schedule tests to run at regular intervals and monitor them for any failures or performance issues.
Scheduling and monitoring pipeline tests is an important part of ensuring the reliability and accuracy of a data pipeline. Best practices include scheduling tests to run at regular intervals, such as daily or weekly, and monitoring them for any failures or performance issues. This allows for early detection and resolution of any issues that may arise. Monitoring the tests only when they fail is not sufficient, as it may not catch issues that occur intermittently or only under certain conditions. Scheduling tests at random intervals or not scheduling them at all can lead to inconsistent results and a lack of visibility into the pipeline's performance.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
As a data engineer, you are responsible for scheduling and monitoring pipeline tests in Azure Data Factory. What are some best practices you should follow to ensure the reliability and accuracy of your tests?
A
Schedule tests to run at random intervals throughout the day.
B
Monitor the tests only when they fail.
C
Schedule tests to run at regular intervals and monitor them for any failures or performance issues.
D
Do not schedule tests, as they are not necessary for monitoring the pipeline.
No comments yet.