Answer-first summary for fast verification
Answer: Use optimized writes to minimize data shuffling during writes.
Using optimized writes can help to reduce the number of small files by ensuring that data is written in a way that minimizes fragmentation. Additionally, compaction techniques can be used to merge small files into larger ones, which can improve query performance by reducing the overhead associated with reading a large number of small files.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
You are working with a Delta table that is experiencing slow query performance due to a large number of small files. Describe how you would identify this issue and what steps you would take to resolve it. Specifically, discuss the use of optimized writes and compaction techniques.
A
Use optimized writes to minimize data shuffling during writes.
B
Increase the number of partitions in the Delta table.
C
Compress the Delta table files to reduce their size.
D
Use data skipping techniques to reduce the amount of data read.
No comments yet.