Answer-first summary for fast verification
Answer: Cloud Composer
Cloud Composer is the ideal choice for automating complex data pipelines on Google Cloud. It's a fully managed workflow orchestration service that enables you to author, schedule, and monitor workflows efficiently. Utilizing a managed Apache Airflow service, Cloud Composer simplifies the creation and management of DAGs (Directed Acyclic Graphs) for your pipeline. It supports scheduling your pipeline for daily execution and integrates seamlessly with managed services like Dataproc and Dataflow for processing. Additionally, Cloud Composer offers advanced monitoring, alerting, and logging features to aid in debugging and optimizing your pipeline.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
No comments yet.
To automate the execution of a complex data pipeline on Google Cloud involving multiple Dataproc and Dataflow jobs with interdependencies, which tool should you use for daily runs, preferring managed services?
A
Cloud Functions
B
Cloud Scheduler
C
Dataproc Workflow Templates
D
Cloud Composer