
Ultimate access to all questions.
Consider a scenario where you need to integrate a pre-trained machine learning model into a Spark environment. Describe the steps you would take to ensure the model is compatible with Spark ML and what potential issues might arise during this integration.
A
Convert the model to a Spark ML format using the Pipeline API; potential issues include data format discrepancies.
B
Re-train the model using Spark MLlib; potential issues include loss of pre-trained model accuracy.
C
Use a direct import function to bring the model into Spark; potential issues include unsupported algorithms.
D
Develop a custom wrapper for the model; potential issues include performance overhead.