In the context of Pandas UDFs, explain the concept of lazy evaluation and its benefits when working with large datasets in Spark. Provide an example of how you would implement lazy evaluation in a Pandas UDF.

Simulated

Lazy evaluation is a technique where the evaluation of an expression is deferred until its value is actually needed.

58.1%

Lazy evaluation is a technique where the evaluation of an expression is performed immediately, but the result is cached for future use.

20.9%

Lazy evaluation is a technique where the evaluation of an expression is performed in parallel across multiple nodes in a cluster.

16.3%

Lazy evaluation is not applicable when working with Pandas UDFs in Spark.

4.7%

Databricks Certified Machine Learning - Associate