
Ultimate access to all questions.
You are responsible for managing a Databricks cluster that uses the Databricks Runtime for Machine Learning. The cluster is used by a team of data scientists who require the installation of a specific version of a Python library that is not compatible with the latest version. Describe the steps you would take to install this specific version of the library on the cluster so that it is available to all notebooks, and explain how you would ensure that this version does not conflict with other libraries on the cluster.
A
Install the specific version of the library manually in each notebook session as it is needed.
B
Use the cluster's library management feature to install the specific version of the library globally, and test its compatibility with other libraries.
C
Ask each data scientist to install the specific version of the library they need in their individual notebook sessions.
D
Create a script that installs the specific version of the library in each notebook session automatically.