Databricks Certified Associate Developer for Apache Spark

Databricks Certified Associate Developer for Apache Spark

Get started today

Ultimate access to all questions.


Which of the following operations will not trigger lazy evaluation in Spark?





Explanation:

In Apache Spark, operations are categorized into transformations and actions. Transformations, such as DataFrame.join(), are lazy and do not trigger evaluation immediately; they only build the execution plan. Actions, on the other hand, such as DataFrame.collect(), DataFrame.count(), DataFrame.first(), and DataFrame.take(), trigger the evaluation of the DataFrame by executing the built plan. Therefore, among the given options, DataFrame.join() is the operation that will fail to trigger evaluation as it is a transformation.