Answer-first summary for fast verification
Answer: Use Dataform to build, manage, and schedule SQL pipelines.
The correct answer is A, which is to use Dataform to build, manage, and schedule SQL pipelines. Dataform is designed specifically for ELT (Extract, Load, Transform) workflows and allows developers to write and manage SQL transformations as code. This aligns perfectly with the requirement that developers are proficient with SQL and want to use an ELT development technique. Additionally, Dataform provides an intuitive coding environment, built-in scheduling capabilities, and facilitates version control, collaboration, and testing of SQL transformations. Other options like Dataflow, Data Fusion, and Cloud Composer are better suited for different use cases or techniques.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
As a data engineer responsible for architecting a data transformation solution for Google BigQuery, consider that your developers are highly proficient in SQL and prefer to utilize the ELT (Extract, Load, Transform) development technique. They require an intuitive coding environment and need to manage SQL as code effectively. How would you identify a suitable solution for your developers to build and manage these data transformation pipelines while meeting their requirements?
A
Use Dataform to build, manage, and schedule SQL pipelines.
B
Use Dataflow jobs to read data from Pub/Sub, transform the data, and load the data to BigQuery.
C
Use Data Fusion to build and execute ETL pipelines.
D
Use Cloud Composer to load data and run SQL pipelines by using the BigQuery job operators.
No comments yet.