Google Professional Data Engineer

Get started today

Ultimate access to all questions.

Explanation:

The correct answer is D. Cloud Composer. Cloud Composer is a fully managed workflow orchestration service built on Apache Airflow, designed for authoring, scheduling, and monitoring workflows. It excels in managing batch jobs with interdependent steps, supporting shell scripts, Hadoop jobs, and BigQuery queries, and allows for defining retries for each task.

A. Cloud Functions: A serverless compute service for event-driven tasks, not suited for complex workflows with dependencies.
B. Cloud Dataflow: A service for processing data pipelines in parallel, not optimized for managing batch jobs with complex dependencies.
C. Cloud Scheduler: A cron job service for scheduling, lacking the workflow orchestration capabilities needed for interdependent steps.

Explanation:

A. Cloud Functions: A serverless compute service for event-driven tasks, not suited for complex workflows with dependencies.
B. Cloud Dataflow: A service for processing data pipelines in parallel, not optimized for managing batch jobs with complex dependencies.
C. Cloud Scheduler: A cron job service for scheduling, lacking the workflow orchestration capabilities needed for interdependent steps.

Comments (0)

No comments yet.

You are tasked with implementing several batch jobs that have interdependent steps requiring execution in a specific sequence. These jobs include shell scripts, Hadoop jobs, and BigQuery queries, with durations varying from minutes to hours. Each failed step must be retried a predetermined number of times. Which service is best suited for managing these jobs?

Real Exam

Cloud Functions

0.0%

Cloud Dataflow

19.0%

Cloud Scheduler

9.5%

Cloud Composer

71.4%