
Explanation:
The correct answer is job/system_lag. This metric is designed to track the maximum duration an item has been waiting in the pipeline. In contrast, job/data_watermark_age indicates the age of the most recent item fully processed by the pipeline. job/elapsed_time measures the total runtime of the pipeline, and job/element_count tallies the number of items processed in a PCollection for specific transforms. For more insights, refer to Building Production-Ready Data Pipelines Using Dataflow Monitoring.
Ultimate access to all questions.
No comments yet.