Google Professional Data Engineer
Get started today
Ultimate access to all questions.
Deep dive into the quiz with AI chat providers.
We prepare a focused prompt with your quiz and certificate details so each AI can offer a more tailored, in-depth explanation.
NO.37 You have Google Cloud Dataflow streaming pipeline running with a Google Cloud Pub/Sub subscription as the source. You need to make an update to the code that will make the new Cloud Dataflow pipeline incompatible with the current version. You do not want to lose any data when making this update. What should you do?
Real Exam
Community
LLeetQuiz
A
Update the current pipeline and use the drain flag.
B
Update the current pipeline and provide the transform mapping JSON object.
C
Create a new pipeline that has the same Cloud Pub/Sub subscription and cancel the old pipeline.
D
Create a new pipeline that has a new Cloud Pub/Sub subscription and cancel the old pipeline.
Explanation:
When making incompatible changes to a Dataflow pipeline with Pub/Sub as the source, creating a new pipeline with a new Pub/Sub subscription ensures no data loss. This approach allows you to:
- Keep the old pipeline running until the new one is fully operational
- Avoid conflicts between pipelines competing for the same messages
- Ensure all messages from the old subscription are processed before switching
- Maintain data integrity during the transition period
Comments
Loading comments...