Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
In the context of using Pandas API on Spark, explain the concept of 'lazy evaluation' and its significance in optimizing the performance of data processing tasks.
A
Lazy evaluation is not applicable to Pandas API on Spark, as it is a concept specific to native Spark operations.
B
Lazy evaluation in Pandas API on Spark means that operations are executed immediately when they are called, without any optimization.
C
Lazy evaluation in Pandas API on Spark means that operations are queued and executed only when necessary, allowing for optimization of the execution plan.
D
Lazy evaluation in Pandas API on Spark means that operations are always executed in a distributed manner, regardless of their complexity.
