Answer-first summary for fast verification
Answer: • Total VMs: 16 • 25 GB per Executor • 10 Cores/Executor
For wide transformations, which involve shuffling data across nodes, performance is optimized by balancing parallelism and resource usage. More executors (VMs) allow better parallelism, while fewer cores per executor reduce contention. Option C (16 VMs, 25 GB, 10 cores) provides the most executors, enabling higher parallelism during shuffles. While 10 cores per executor is higher than the ideal 5, it is significantly better than other options like B (20 cores) or D (40 cores), which risk resource contention. Option C’s smaller executors also reduce data per node during shuffles, minimizing network overhead. Although 25 GB per executor is less than B’s 50 GB, the question assumes all configurations are valid, implying 25 GB is sufficient to avoid spilling. Thus, Option C maximizes performance by leveraging parallelism and efficient resource utilization.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
Which of the following cluster configurations will deliver the highest performance for a job containing at least one wide transformation, given that each configuration has identical total resources (400 GB RAM, 160 cores) with only one Executor per VM?
A
• Total VMs; 1 • 400 GB per Executor • 160 Cores / Executor
B
• Total VMs: 8 • 50 GB per Executor • 20 Cores / Executor
C
• Total VMs: 16 • 25 GB per Executor • 10 Cores/Executor
D
• Total VMs: 4 • 100 GB per Executor • 40 Cores/Executor
E
• Total VMs:2 • 200 GB per Executor • 80 Cores / Executor
No comments yet.