
Ultimate access to all questions.
You are responsible for setting up a Databricks cluster for a team of data scientists who will be working on a variety of machine learning projects. The team has requested that certain Python libraries, including scikit-learn and pandas, be pre-installed on the cluster. Describe the process you would follow to ensure that these libraries are available to all notebooks on the cluster, and explain how you would handle updates to these libraries in the future.
A
Install the libraries manually in each notebook session as they are needed.
B
Use the cluster's library management feature to install the libraries globally, and schedule regular updates for these libraries.
C
Ask each data scientist to install the libraries they need in their individual notebook sessions.
D
Create a script that installs the libraries in each notebook session automatically.