
Ultimate access to all questions.
In a scenario where you are tasked with setting up a Databricks cluster for a machine learning project that requires the installation of a custom Python library, describe the process you would follow to ensure that this library is available to all notebooks on the cluster. Additionally, explain how you would handle potential updates to this custom library in the future.
A
Install the custom library manually in each notebook session as it is needed.
B
Use the cluster's library management feature to install the custom library globally, and monitor for updates to the library.
C
Ask each data scientist to install the custom library they need in their individual notebook sessions.
D
Create a script that installs the custom library in each notebook session automatically.