Answer-first summary for fast verification
Answer: Implement a distributed data ingestion system that can scale horizontally.
Option B is the correct approach for designing a data ingestion pipeline that can handle high-velocity data streams. A distributed data ingestion system can scale horizontally by adding more processing units as the data volume increases, ensuring the pipeline's efficiency and scalability. Option A is not suitable as it can lead to a single point of failure and may not handle high data volumes efficiently. Option C is not ideal as it limits the pipeline's ability to process high-velocity data streams. Option D is not recommended as batch processing may not be suitable for real-time data processing requirements.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
In a big data processing scenario, you are required to design a data ingestion pipeline that can handle high-velocity data streams. What considerations should you take into account to ensure the pipeline's efficiency and scalability?
A
Use a single centralized system to process all incoming data streams.
B
Implement a distributed data ingestion system that can scale horizontally.
C
Restrict the data ingestion rate to avoid overloading the system.
D
Use a batch processing approach to simplify the pipeline design.
No comments yet.