Answer-first summary for fast verification
Answer: Implement the OPTIMIZE command on the delta table to consolidate smaller files into larger ones.
The slowdown in read queries is due to the manual insertion of data via numerous INSERT statements, resulting in a plethora of small files. Each query necessitates scanning these many small files, which is inefficient. The OPTIMIZE command merges these small files into larger ones, thereby reducing the number of files scanned during queries and significantly improving read performance. More Info: Combining small files using OPTIMIZE
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
In a cricket match, every ball bowled is recorded in a delta table, including the bowler's name, batter's name, and runs scored, via manual INSERT statements. After 350 matches, read queries on this table are slower than on other tables of similar size. What efficient technique can the data engineer employ to address this issue?
A
Convert the data to CSV format to enhance read speed.
B
Implement the OPTIMIZE command on the delta table to consolidate smaller files into larger ones.
C
Create separate tables for each cricket match to distribute the data.
D
Utilize Change Data Feed to accelerate read queries.
E
After a match concludes, transfer its data to a new table with a single INSERT statement.
No comments yet.