Answer-first summary for fast verification
Answer: Use the cluster's library management feature to install the specific version of the library globally, and test its compatibility with other libraries.
Option B is the most efficient and reliable approach. By using the cluster's library management feature to install the specific version of the library globally, it ensures that all notebooks have access to the library without the need for manual installation by each user. Testing the library's compatibility with other libraries helps to prevent potential conflicts or issues.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
You are responsible for managing a Databricks cluster that uses the Databricks Runtime for Machine Learning. The cluster is used by a team of data scientists who require the installation of a specific version of a Python library that is not compatible with the latest version. Describe the steps you would take to install this specific version of the library on the cluster so that it is available to all notebooks, and explain how you would ensure that this version does not conflict with other libraries on the cluster.
A
Install the specific version of the library manually in each notebook session as it is needed.
B
Use the cluster's library management feature to install the specific version of the library globally, and test its compatibility with other libraries.
C
Ask each data scientist to install the specific version of the library they need in their individual notebook sessions.
D
Create a script that installs the specific version of the library in each notebook session automatically.
No comments yet.