Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
A machine learning engineer is scaling the inference of a single-node model on a Spark DataFrame with one million records using a specific code block. What is the primary advantage of using an Iterator in this context?
A
The model will be confined to a single executor, limiting data distribution.
B
Data will be confined to a single executor, reducing the need for multiple model loads.
C
Data will be spread across multiple executors for inference processing.
D
Including an Iterator offers no advantages in this scenario.
E
The model is loaded just once per executor, not per batch, enhancing inference efficiency.
