Answer-first summary for fast verification
Answer: Deploy multiple consumers in a consumer group with manual offset management and high availability configurations.
Option B is correct because it involves deploying multiple consumers in a consumer group, which helps manage the load and ensures high availability. Manual offset management allows for more control over data processing. Using a single consumer (Option A) does not provide redundancy or load balancing. Directly streaming data to S3 (Option C) does not address the need for real-time processing. AWS Glue is not suitable for real-time processing (Option D).
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
You are designing a data ingestion pipeline that requires reading data from an Amazon MSK cluster and processing it in real-time. The system must handle a high volume of data and ensure that processing does not lag behind the incoming data rate. Describe how you would configure a consumer application to read from the MSK cluster, including strategies for managing consumer group offsets and ensuring high availability.
A
Use a single consumer with automatic offset management and no redundancy.
B
Deploy multiple consumers in a consumer group with manual offset management and high availability configurations.
C
Directly stream data from MSK to Amazon S3 without intermediate processing.
D
Use AWS Glue to process data from MSK in real-time.
No comments yet.