
Ultimate access to all questions.
You are designing a data pipeline for a smart city project that involves aggregating sensor data collected every minute from thousands of IoT devices deployed across the city. The project requires real-time analysis to monitor traffic flow, air quality, and energy usage to make immediate adjustments. Given the need for low latency processing, scalability to handle the volume of data, and the ability to provide real-time insights, which data pipeline type would you choose? (Choose one correct option)
A
Data warehousing pipeline, suitable for storing and analyzing historical data but not optimized for real-time processing.
B
Batch and streaming hybrid pipeline, which offers flexibility but may introduce unnecessary complexity for purely real-time needs.
C
Real-time streaming data pipeline, designed for low latency processing and continuous data ingestion from IoT devices.
D
Batch data pipeline, which processes data in large chunks at scheduled intervals, not suitable for real-time analysis.