
Explanation:
The correct answer is job/system_lag. This metric is designed to track the maximum duration an item has been waiting in the pipeline. In contrast, job/data_watermark_age indicates the age of the most recent item fully processed by the pipeline. job/elapsed_time measures the total runtime of the pipeline, and job/element_count tallies the number of items processed in a PCollection for specific transforms. For more insights, refer to Building Production-Ready Data Pipelines Using Dataflow Monitoring.
To effectively monitor a Cloud Dataflow job and identify the maximum duration an item has been waiting in the pipeline, which Cloud Monitoring metric should you utilize?
A
job/element_count
B
job/system_lag
C
job/elapsed_time
D
job/data_watermark_age
No comments yet.