Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
Discuss the importance of choosing the right file format for storing data in a data lake. How do different file formats like Parquet, ORC, and Avro impact query performance and storage efficiency?
A
Parquet and ORC are columnar formats that are highly efficient for read-heavy workloads and support advanced optimizations like predicate pushdown and column pruning.
B
Avro is the best choice for all scenarios due to its compact size and efficient serialization, which makes it superior for both storage and query performance.
C
Text files are the most efficient for storage and query performance as they are simple and do not require any additional processing.
D
File format does not impact query performance or storage efficiency, as these are primarily determined by the data processing engine.
