Google Professional Data Engineer

Google Professional Data Engineer

Get started today

Ultimate access to all questions.


Imagine you're utilizing Apache Kafka for ingesting messages from IoT sensors, with a data pipeline powered by Apache Flink processing this data before it's stored long-term. If you're planning to migrate this setup to Google Cloud and prefer using managed services over Apache Kafka and Apache Flink, which two services would you opt for?





Explanation:

The optimal choices for replacing Apache Kafka and Apache Flink in Google Cloud are Cloud Pub/Sub and Cloud Dataflow, respectively. Cloud Pub/Sub serves as a robust messaging service, while Cloud Dataflow operates as an Apache Beam runner, akin to Apache Flink's functionality. Alternatives like Cloud Data Fusion and Cloud Composer cater to ETL processes and workflow orchestration, respectively, and Cloud Firestore is designed as a NoSQL document database. For more insights, explore Cloud Pub/Sub, Cloud Dataflow, and Google Cloud's blog on data processing.