Answer-first summary for fast verification
Answer: Use the cluster's library management feature to install the library globally, and test its compatibility with the existing environment.
Option B is the most efficient and reliable approach. By using the cluster's library management feature to install the library globally, it ensures that all notebooks have access to the library without the need for manual installation by each user. Testing the library's compatibility with the existing environment before deployment helps to prevent potential conflicts or issues.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
No comments yet.
A data science team is using a Databricks cluster with the Databricks Runtime for Machine Learning to develop and deploy machine learning models. The team has identified a need for a new Python library that is not currently installed on the cluster. Describe the steps you would take to install this new library on the cluster so that it is available to all notebooks, and explain how you would ensure that the library is compatible with the existing environment.
A
Install the library manually in each notebook session as it is needed.
B
Use the cluster's library management feature to install the library globally, and test its compatibility with the existing environment.
C
Ask each data scientist to install the library they need in their individual notebook sessions.
D
Create a script that installs the library in each notebook session automatically.