Databricks Certified Data Engineer - Professional
Get started today
Ultimate access to all questions.
Comments
Loading comments...
Ultimate access to all questions.
When processing a large DataFrame in Spark with multiple transformations, which method ensures the most efficient execution?
A
Use UDFs for all transformations to improve readability and maintainability.
B
Chain transformations together before executing any actions to leverage Spark‘s lazy evaluation.
C
Apply transformations sequentially, and call .cache() after each transformation.
D
Execute an action after each transformation to immediately view results and ensure correctness.