
Ultimate access to all questions.
You are managing a series of Spark jobs that execute on a Cloud Dataproc cluster based on a defined schedule. These jobs have dependencies; some must execute in a specific sequence, while others can run concurrently. Your task is to automate the execution and orchestration of these jobs. How should you proceed to achieve this automation effectively?
A
Create a Cloud Dataproc Workflow Template
B
Create an initialization action to execute the jobs
C
Create a Directed Acyclic Graph in Cloud Composer
D
Create a Bash script that uses the Cloud SDK to create a cluster, execute jobs, and then tear down the cluster