Answer-first summary for fast verification
Answer: Set up a Kafka cluster on GCE VM instances and configure the on-prem cluster to mirror the topics to the GCE cluster. Then use either a Dataproc cluster or Dataflow job to read from Kafka and write to GCS.
The most efficient method to replicate web application log data from an on-premises Apache Kafka cluster to Google Cloud, without deploying Kafka Connect plugins, involves setting up a Kafka cluster on GCE VM instances. Configure the on-premises cluster to mirror topics to the GCE cluster. Subsequently, utilize either a Dataproc cluster or a Dataflow job to read data from Kafka and write it to Google Cloud Storage (GCS) for analysis in BigQuery and Cloud Storage.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
How can you efficiently replicate web application log data from an on-premises Apache Kafka cluster to Google Cloud for analysis in BigQuery and Cloud Storage, without the need for Kafka Connect plugins?
A
Install the Pub/Sub Kafka connector on the on-prem Kafka cluster and configure Pub/Sub as a Sink connector. Use a Dataflow job to read from Pub/Sub and write to GCS.
B
Set up a Kafka cluster on GCE VM instances and configure the on-prem cluster to mirror the topics to the GCE cluster. Then use either a Dataproc cluster or Dataflow job to read from Kafka and write to GCS.
C
Create a Kafka cluster on GCE VM instances with the Pub/Sub Kafka connector configured as a Sink connector. After that, use either a Dataproc cluster or Dataflow job to read from Kafka and write to GCS.
D
Install the Pub/Sub Kafka connector on the on-prem Kafka cluster and configure Pub/Sub as a Source connector. Use a Dataflow job to read from Pub/Sub and write to GCS.
No comments yet.