Ultimate access to all questions.
You are tasked with designing an ETL pipeline for a large e-commerce company that needs to process both structured and unstructured data from various sources including customer reviews, sales transactions, and social media feeds. The company requires real-time analytics to make quick business decisions. Describe how you would design this ETL pipeline, including the tools and technologies you would use, and explain how you would handle the challenges posed by the volume, velocity, and variety of data.