Explanation:
The most efficient method to replicate web application log data from an on-premises Apache Kafka cluster to Google Cloud, without deploying Kafka Connect plugins, involves setting up a Kafka cluster on GCE VM instances. Configure the on-premises cluster to mirror topics to the GCE cluster. Subsequently, utilize either a Dataproc cluster or a Dataflow job to read data from Kafka and write it to Google Cloud Storage (GCS) for analysis in BigQuery and Cloud Storage.
Ultimate access to all questions.
No comments yet.
How can you efficiently replicate web application log data from an on-premises Apache Kafka cluster to Google Cloud for analysis in BigQuery and Cloud Storage, without the need for Kafka Connect plugins?
A
Install the Pub/Sub Kafka connector on the on-prem Kafka cluster and configure Pub/Sub as a Sink connector. Use a Dataflow job to read from Pub/Sub and write to GCS.
B
Set up a Kafka cluster on GCE VM instances and configure the on-prem cluster to mirror the topics to the GCE cluster. Then use either a Dataproc cluster or Dataflow job to read from Kafka and write to GCS.
C
Create a Kafka cluster on GCE VM instances with the Pub/Sub Kafka connector configured as a Sink connector. After that, use either a Dataproc cluster or Dataflow job to read from Kafka and write to GCS.
D
Install the Pub/Sub Kafka connector on the on-prem Kafka cluster and configure Pub/Sub as a Source connector. Use a Dataflow job to read from Pub/Sub and write to GCS.