Ultimate access to all questions.
You are tasked with optimizing an existing ETL pipeline that processes large volumes of sensor data from IoT devices. The current pipeline suffers from high latency and processing bottlenecks. Describe the steps you would take to optimize this pipeline, including the tools and techniques you would use to improve its performance and reliability.