Ultimate access to all questions.
You are designing a data ingestion pipeline that requires reading data from an Amazon MSK cluster and processing it in real-time. The system must handle a high volume of data and ensure that processing does not lag behind the incoming data rate. Describe how you would configure a consumer application to read from the MSK cluster, including strategies for managing consumer group offsets and ensuring high availability.