
Ultimate access to all questions.
In a scenario where you are tasked with optimizing a Databricks cluster running the Databricks Runtime for Machine Learning, which is experiencing performance issues during model training due to library conflicts, describe the steps you would take to resolve these issues. Consider the need to maintain access to necessary libraries while preventing conflicts.
A
Remove all libraries from the cluster and reinstall them one by one, testing for conflicts.
B
Create isolated environments for each project within the cluster, each with its own set of libraries.
C
Upgrade the Databricks Runtime for Machine Learning to the latest version, which may have resolved library conflicts.
D
Instruct data scientists to install only the libraries they need in their individual notebook sessions.