Ultimate access to all questions.
Upgrade Now 🚀
Sign in to unlock AI tutor
Describe the process of building a machine learning pipeline in Spark ML. What are the key components of a pipeline, and how do they interact with each other during the training and evaluation phases?
A
A pipeline in Spark ML consists of data ingestion and model training stages; they interact sequentially.
B
A pipeline in Spark ML includes multiple stages like data preprocessing, feature extraction, model training, and evaluation; stages are executed in sequence or in parallel based on the pipeline design.
C
A pipeline in Spark ML is a single-stage process focusing only on model training; no interaction between stages.
D
A pipeline in Spark ML involves outsourcing stages to external services; interactions are managed via APIs.