Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
Explain how lazy evaluation works in native Spark DataFrames and how it differs from the evaluation strategy in Pandas API on Spark. Provide a detailed example to illustrate the differences.
A
Lazy evaluation in native Spark DataFrames means that transformations are executed immediately, while in Pandas API on Spark, transformations are executed only when an action is called.
B
Lazy evaluation in native Spark DataFrames means that transformations are executed only when an action is called, while in Pandas API on Spark, transformations are executed immediately.
C
Lazy evaluation in both native Spark DataFrames and Pandas API on Spark means that transformations are executed immediately.
D
Lazy evaluation in both native Spark DataFrames and Pandas API on Spark means that transformations are executed only when an action is called.
