A machine learning engineer is scaling the inference of a single-node model on a Spark DataFrame with one million records using a specific code block. What is the primary advantage of using an Iterator in this context?

Real Exam

The model will be confined to a single executor, limiting data distribution.

9.8%

Data will be confined to a single executor, reducing the need for multiple model loads.

17.1%

Data will be spread across multiple executors for inference processing.

22.0%

Including an Iterator offers no advantages in this scenario.

7.3%

The model is loaded just once per executor, not per batch, enhancing inference efficiency.

43.9%

Databricks Certified Machine Learning - Associate